【摘要】 为了实现增强现实环境下的自然人手3D交互,提出一套针对不佩戴任何标记的人手的3D交互算法.该算法经过区域检测跟踪、特征点提取和3D稀疏结构重建等步骤获取人手的3D结构;在此基础上提出基于指尖、指向和手掌平面的人手3D交互模式;将从真实世界提取的3D交互信息对齐到虚拟世界,融合渲染并触发交互,实现自然人手3D交互.实验结果表明,该算法具有较高的沉浸感、精确度和易用性.更多还原

【Abstract】 In order to achieve hand based natural behavior interaction in augmented reality,this paper proposes a 3D interaction algorithm for marker-free hand.This algorithm uses a series of steps of hand detection,hand feature extraction and hand 3D structure reconstruction to get 3D structure of a bare hand.Based on this,we extract 3 basic 3D interaction modes of hand: point,line and plane in real world and align them in the virtual world to achieve hand based natural behavior 3D interaction in the environment of augmented reality.This paper also presents experimental results to verify the superior performance,accuracy and flexibility of the proposed approaches.更多还原