Face tracking and hand gesture recognition for human-robot interaction
- 1 January 2004
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1901-1906 Vol.2
- https://doi.org/10.1109/robot.2004.1308101
Abstract
The interaction between man and machines has become an important topic for the robotic community as it can generalise the use of robots. For active H/R interaction scheme, the robot needs to detect human faces in its vicinity and then interpret canonical gestures of the tracked person assuming this interlocutor has been beforehand identified. In this context, we depict functions suitable to detect and recognise faces in video stream and then focus on face or hand tracking functions. An efficient colour segmentation based on a watershed on the skin-like coloured pixels is proposed. A new measurement model is proposed to take into account both shape and colour cues in the particle filter to track face or hand silhouettes in video stream. An extension of the basic condensation algorithm is proposed to achieve recognition of the current hand posture and automatic switching between multiple templates in the tracking loop. Results of tracking and recognition using are illustrated in the paper and show the process robustness in cluttered environments and in various light conditions. The limits of the method and future works are also discussed.Keywords
This publication has 11 references indexed in Scilit:
- Visual landmarks detection and recognition for mobile robot navigationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- A mixed-state condensation tracker with automatic model-switchingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- An unsupervised color image segmentation algorithm for face detection applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robust face tracking using colorPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Face Detection: A SurveyComputer Vision and Image Understanding, 2001
- Comparing and evaluating interest pointsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selectionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Towards Model-Based Recognition of Human Movements in Image SequencesCVGIP: Image Understanding, 1994
- A note on the gradient of a multi-imageComputer Vision, Graphics, and Image Processing, 1986
- Color information for region segmentationComputer Graphics and Image Processing, 1980