面向馆藏数字资源的多模交互模型与影响因素研究

目的 /意义]面对数字资源的智能化、可感知、沉浸式和可互动的未来趋势，三维实体、全景视频等新型资源形态成为记载和传播知识的重要形式。以往用户界面模型难以较好地支撑图博档等公共机构的互动情境式数字文化服务，公众需求和交互情境更迭呼唤沉浸体验、自然流畅的新型交互界面。方法 /过程]通过对数字馆藏资源与服务、多模交互界面与体验的相关问题进行探讨，提出面向馆藏数字资源的多模交互界面模型；多模交互的信息交换过程须以人的信息加工能力为约束，通过给出多模交互的信息加工模型，剖析虚拟现实情境下馆藏资源的用户交互认知过程。立足面向馆藏资源的多模交互模型，基于“界面-认知-情境”递进逻辑，分析影响用户交互体验的关键因素。结果 /结论 ]面向馆藏数字资源的多模交互界面模型应由交互模态、交互原语、交互任务三个关联递进的层级构成，以人为核心的多模交互可在多模感知、思维决策和交互执行等阶段增强人类的认知能力。沉浸流畅的用户交互体验取决于界面感知交互模态、心智模型匹配程度、交互情境沉浸维度等关键因素，可为多模交互设计、数字文化服务开展等提供参考。

Research on Multi-Mode Interaction Model and Influencing Factors for Digital Collections

Purpose/Significance] In recent years, there has been a trend toward digital collections, that are multisensory, realistic, and interactive. New resource forms such as 3D collections and panoramic videos have become important forms of recording and disseminating knowledge. It is difficult to support these situation-based interactive digital cultural services of public institutions by traditional user interface, such as libraries, museums and archives. Therefore, public needs and expanding interactive situations call for the new user interface with immersive and natural characteristics. Method/Process] Based on the discussion of the related issues on digital collection resources and services, multi-mode interface and experience, this paper proposed the multi-modal interface model for digital collections. Based on the information processing model of multi-modal interaction, the information exchange process of multi-mode interaction should be constrained by people’s information processing ability. By giving a multi-mode interactive information processing model, the interactive cognition process of collection resources in virtual reality is analyzed. Then, based on the multi-mode interaction model for collection resources, according to the progressive logic of “interface-cognition-context”, this study analyzed the key factors affecting user experience (UE). Result/Conclusion] The multi-mode interaction interface for digital collections is composed of 3 progressive levels of interaction modality, interaction primitive and interaction task. Human-centered multi-mode interaction could enhance human’s cognitive abilities in the stages of multi-mode perception, thinking decision-making and interactive execution. The key influencing factors of immersive UE involve perceptual and interactive modality, matching degree of mental model, immersion dimension of interaction scenario, which can provide reference for multimode interaction design as well as digital culture services.