节点文献

面向大词汇量的实时连续中国手语识别系统

A Real-Time Large Vocabulary Continuous Recognition System for Chinese Sign Language

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 王春立高文马继涌

【Author】 WANG Chun Li 1) GAO Wen 2),3) Ma Ji Yong 2) 1) (Department of Computer, Dalian University of Technology, Dalian 116023) 2) (Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100080) 3) (D

【机构】 大连理工大学计算机系中国科学院计算技术研究所中国科学院计算技术研究所 大连116023北京100080哈尔滨工业大学计算机科学与工程系哈尔滨150001

【摘要】 目前手语识别研究的难点之一在于如何实现大词汇量的连续语句识别 .针对这个问题 ,该文提出了几个有效的方法 ,包括修正转移矩阵、状态结点的捆绑、快速匹配、在搜索路径中加入词跳转的估计参数等 .利用上述技术 ,该文实现了一个基于数据手套和位置跟踪器的大词汇量的连续的中国手语实时识别系统 .对中国手语辞典中收录的 5 10 0个词以及一批连续语句作实验 ,实验结果表明 ,文中所介绍的技术在提高系统识别速度和准确率方面都很有效

【Abstract】 Gestures are destined to play an increasingly important role in human computer interaction in the future. Closely related to the field of gesture recognition is the field of sign language recognition. Sign languages are the primary mode of communication for many deaf people, and because they are full fledged languages in their own rights, they offer a much more structured and constrained research environment than general gestures. Furthermore, working on sign language recognition systems would also make the interaction of deaf people with their surroundings easier. Most previous work has focused on isolated sign language recognition and continuous recognition based on small set of signs. Hitherto, one of the major challenge that faces Sign Language recognition is to develop methods that will scale well with increasing vocabulary size. In this paper, a novel approach to continuous, whole sentence Chinese Sign Language (CSL) recognition based on large vocabulary is presented. In order to improve the recognition speed and accuracy, some useful new ideas are proposed in this paper, including modifying the transferring probability, states tying, fast matching and using the estimating parameter of transferring between signs in search algorithm. The aim of state tying is to reduce computation load in decoding process. Fast matching is used to decide which signs is the potential one. Adding a parameter can weaken the effect of the extra movement between two signs. Using these techniques, a real time system designed for recognizing continuous Chinese Sign Language sentences with a large vocabulary based on two CyberGloves and a tracker is built. Experiments are carried out on 5100 signs included in Chinese Sign Language Dictionary. 1000 continuous sentences are test. These sentences are made randomly based on the vocabulary. The results show that the techniques proposed in this paper are efficient on either recognition speed or recognition rate. The sentences can be recognized in real time.

【关键词】 手语识别HMMs聚类状态结点的捆绑
【Key words】 sign language recognitionHMMsclusterstate tying
【基金】 国家自然科学基金重点项目 (697893 0 1);中国科学院百人工程计划资助
  • 【文献出处】 计算机学报 ,Chinese Journal of Computers , 编辑部邮箱 ,2002年06期
  • 【分类号】TP391.4
  • 【被引频次】17
  • 【下载频次】391
节点文献中: