Human-Computer Interaction Based on Hand Gestures Using RGB-D Sensors
Open Access
- 5 September 2013
- Vol. 13 (9), 11842-11860
- https://doi.org/10.3390/s130911842
Abstract
In this paper we present a new method for hand gesture recognition based on an RGB-D sensor. The proposed approach takes advantage of depth information to cope with the most common problems of traditional video-based hand segmentation methods: cluttered backgrounds and occlusions. The algorithm also uses colour and semantic information to accurately identify any number of hands present in the image. Ten different static hand gestures are recognised, including all different combinations of spread fingers. Additionally, movements of an open hand are followed and 6 dynamic gestures are identified. The main advantage of our approach is the freedom of the user’s hands to be at any position of the image without the need of wearing any specific clothing or additional devices. Besides, the whole method can be executed without any initial training or calibration. Experiments carried out with different users and in different environments prove the accuracy and robustness of the method which, additionally, can be run in real-time.Keywords
This publication has 19 references indexed in Scilit:
- Analysis of the Accuracy and Robustness of the Leap Motion ControllerSensors, 2013
- Rapid Characterization of Vegetation Structure with a Microsoft Kinect SensorSensors, 2013
- A robust method of detecting hand gestures using depth sensorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Categorization of Indoor Places Using the Kinect SensorSensors, 2012
- Magic Ring: A Finger-Worn Device for Multiple Appliances Control Using Static Finger GesturesSensors, 2012
- A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilitiesResearch in Developmental Disabilities, 2011
- Development of a Fingertip Glove Equipped with Magnetic Tracking SensorsSensors, 2010
- Hand Tracking and Gesture Recognition for Human-Computer InteractionELCVIA Electronic Letters on Computer Vision and Image Analysis, 2005
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004
- Neural network-based face detectionIeee Transactions On Pattern Analysis and Machine Intelligence, 1998