位置:成果数据库 > 期刊 > 期刊详情页
面向手语自动翻译的基于Kinect的手势识别
  • ISSN号:0476-0301
  • 期刊名称:《北京师范大学学报:自然科学版》
  • 时间:0
  • 分类:TP391.4[自动化与计算机技术—计算机应用技术;自动化与计算机技术—计算机科学与技术]
  • 作者机构:[1]北京师范大学信息科学与技术学院,北京100875
  • 相关基金:国家自然科学基金资助项目(61170203)
中文摘要:

提出了一种基于3D体感摄像机Kinect设备实现面向手语自动翻译的手势识别方法,利用Kinect体感外设提供的深度图像实现手的检测,并通过OpenNI+NITE框架中函数获得手掌质心在三维空间中的位置,然后通过等值线追踪算法(又称围线追踪算法)和三点定位算法识别出手指实现了手势跟踪,最后通过矢量匹配方法识别手指名字,并设计了三层分类器来实现静态手势语的识别.相较于传统的基于数据手套和单目摄像机的方法,本方法识别的更准确.基于上述方法,实现了一个手势识别系统.实验结果显示,本文提出的方法更加简洁且行之有效.

英文摘要:

For a long time, barriers exist in communication to people with hearing disability. To them, being able to effectively communicate with other people has been a dream that seems may never come true. With the invention of computer and technological advances, this dream would be possible in the future. Researchers have always been trying to achieve automated sign language translation by utilizing Human- Computer Interaction (HCI), computer graphics, computer vision and pattern recognition. Most of previous work is based on videos. This paper proposed a gesture recognition method for automated sign language translation based on depth images provided by Kinect, a three-dimensional (3D) motion sensing input device. The 3D coordinates of palm center was computed by using NITE middleware and an open source framework ()penNI. Then fingers were recognized and hand gesture was detected through adopting contour tracing algorithm and three-point alignment algorithm. The names of fingers were recognized using vector fitting method. Three layers of classifiers were designed to achieve static hand gesture recognition successfully. Compared with traditional methods using data gloves and monocular cameras, the present method was more accurate. Our experiments showed that the method was concise and effective.

同期刊论文项目
同项目期刊论文
期刊信息
  • 《北京师范大学学报:自然科学版》
  • 中国科技核心期刊
  • 主管单位:中华人民共和国教育部
  • 主办单位:北京师范大学
  • 主编:刘文彪
  • 地址:北京新外大街19号
  • 邮编:100875
  • 邮箱:JBNUNS@bnu.EDU.CN
  • 电话:
  • 国际标准刊号:ISSN:0476-0301
  • 国内统一刊号:ISSN:11-1991/N
  • 邮发代号:82-406
  • 获奖情况:
  • 1997年全国第二届科技期刊评比一等奖,1999年教育部优秀科技期刊二等奖,1999年首届国家期刊奖,中国期刊方阵“双高”期刊
  • 国内外数据库收录:
  • 俄罗斯文摘杂志,美国化学文摘(网络版),美国数学评论(网络版),德国数学文摘,英国科学文摘数据库,英国动物学记录,日本日本科学技术振兴机构数据库,中国中国科技核心期刊,中国北大核心期刊(2004版),中国北大核心期刊(2008版),中国北大核心期刊(2011版),中国北大核心期刊(2014版),中国北大核心期刊(2000版)
  • 被引量:10672