将多通道交互用于虚拟环境,研究自然和谐的交互方式已经成为虚拟现实的一个重要研究方向.文中以城市规划为应用背景,融合跟踪器、语音和笔输入,提出概率合一的任务制导多通道整合,并辅以上下文语义;以此为基础,有针对性地设计了多通道交互技术,并依据多通道交互的特性分别进行阐述,实现了自然、高效的多通道虚拟城市规划.
It becomes an important direction in virtual reality to employ multimodal interaction in virtual environment for providing a natural and harmonious interactive mode. In this paper, in combination with context, a task-oriented and probability-unified multimodal integration method is presented to integrate the trackers' input, voice and pen input for virtual city planning. Based on this method, several multimodal interaction techniques are designed to allow city planning task much simpler and more intuitive, and they are depicted according to the characteristics of multimodal interaction.