针对残疾人士不用手实现计算机操作的问题,提出了一种通过面部姿态的视觉分析手段控制鼠标操作的新方法。首先,由CCD摄像头获得人脸视频图像,采用Haar特征和基于AdaBoost算法的目标检测手段确定人脸区域,再通过图像分析手段提取2个眼角、2个嘴角和鼻尖共5个特征点;然后,以一幅正面图像的特征点位置为参考,对实时图像中人脸的空间姿态进行估计;最后,根据人脸的3个偏转角定义并生成人机交互信息,用于计算机人机界面中鼠标位置的移动和操作控制。实验表明,在良好的光照条件下,该方法可以快速准确完成人脸姿态估计并获得鼠标控制信息,帮助伤残人士实现人机信息交互。
Focusing on the problem of computer operation without hand for the disabled people, a new method of mouse control based on visual analysis of the face poses is proposed. First, the face images from CCD camera are obtained and the face areas are located based on AdaBoost algorithms with Haar features. Then, 5 feature points including 2 eye corners, 2 mouth corners and nose tip are detected with image analysis. A~ter that, With help of the feature points in a predefined frontal face image, the face poses are estimated in the real-time face images. Finally, the 3 deflection angles are adopted to define human computer interactive information, which can be used to determine positions and operations of the mouse in the human computer interactive interface. The experimental results demonstrate the efficiency of our method that the face poses can be estimated accurately as well as the operation information to the mouse be achieved rapidly. It is valuable in human computer interaction for the disabled people.