Robust Hand Motion Tracking through Data Fusion of 5DT Data Glove and Nimble VR Kinect Camera Measurements
Open Access
- 14 December 2015
- Vol. 15 (12), 31644-31671
- https://doi.org/10.3390/s151229868
Abstract
Vision based interfaces for human computer interaction have gained increasing attention over the past decade. This study presents a data fusion approach of the Nimble VR vision based system, using the Kinect camera, with the contact based 5DT Data Glove. Data fusion was achieved through a Kalman filter. The Nimble VR and filter output were compared using measurements performed on (1) a wooden hand model placed in various static postures and orientations; and (2) three differently sized human hands during active finger flexions. Precision and accuracy of joint angle estimates as a function of hand posture and orientation were determined. Moreover, in light of possible self-occlusions of the fingers in the Kinect camera images, data completeness was assessed. Results showed that the integration of the Data Glove through the Kalman filter provided for the proximal interphalangeal (PIP) joints of the fingers a substantial improvement of 79% in precision, from 2.2 deg to 0.9 deg. Moreover, a moderate improvement of 31% in accuracy (being the mean angular deviation from the true joint angle) was established, from 24 deg to 17 deg. The metacarpophalangeal (MCP) joint was relatively unaffected by the Kalman filter. Moreover, the Data Glove increased data completeness, thus providing a substantial advantage over the sole use of the Nimble VR system.Keywords
Funding Information
- Technologiestichting STW (12137)
This publication has 41 references indexed in Scilit:
- Human-Computer Interaction Based on Hand Gestures Using RGB-D SensorsSensors, 2013
- Analysis of the Accuracy and Robustness of the Leap Motion ControllerSensors, 2013
- Effectiveness of Laparoscopic Computer Simulator Versus Usage of Box Trainer for Endoscopic Surgery Training of NovicesJournal of Surgical Education, 2011
- Video Games and Surgical Ability: A Literature ReviewJournal of Surgical Education, 2010
- Effects of visual force feedback on robot-assisted surgical task performanceThe Journal of Thoracic and Cardiovascular Surgery, 2008
- Correlating virtual reality and box trainer tasks in the assessment of laparoscopic surgical skillsAmerican Journal of Obstetrics and Gynecology, 2007
- Vision-based hand pose estimation: A reviewComputer Vision and Image Understanding, 2007
- The role of medical simulation: an overviewInternational Journal of Medical Robotics and Computer Assisted Surgery, 2006
- Visual interpretation of hand gestures for human-computer interaction: a reviewIeee Transactions On Pattern Analysis and Machine Intelligence, 1997
- The estimation of the gradient of a density function, with applications in pattern recognitionIEEE Transactions on Information Theory, 1975