Parsing the Hand in Depth Images
- 13 February 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 16 (5), 1241-1253
- https://doi.org/10.1109/tmm.2014.2306177
Abstract
Hand pose tracking and gesture recognition are useful for human-computer interaction, while a major problem is the lack of discriminative features for compact hand representation. We present a robust hand parsing scheme to extract a high-level description of the hand from the depth image. A novel distance-adaptive selection method is proposed to get more discriminative depth-context features. Besides, we propose a Superpixel-Markov Random Field (SMRF) parsing scheme to enforce the spatial smoothness and the label co-occurrence prior to remove the misclassified regions. Compared to pixel-level filtering, the SMRF scheme is more suitable to model the misclassified regions. By fusing the temporal constraints, its performance can be further improved. Overall, the proposed hand parsing scheme is accurate and efficient. The tests on synthesized dataset show it gives much higher accuracy for single-frame parsing and enhanced robustness for continuous sequence parsing compared to benchmarks. The tests on real-world depth images of the hand and human body show the robustness to complex hand configurations of our method and its generalization power to different kinds of articulated objects.Keywords
This publication has 28 references indexed in Scilit:
- Model-based hand pose estimation via spatial-temporal hand parsing and 3D fingertip localizationThe Visual Computer, 2013
- Graph cuts optimization for multi-limb human segmentation in depth mapsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- A data-driven approach for real-time full body pose reconstruction from a depth cameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Real time hand pose estimation using depth sensorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Depth kernel descriptors for object recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Motion capture with constrained inverse kinematics for real-time hand trackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Real-time hand-tracking with a color gloveACM Transactions on Graphics, 2009
- A Review on Vision-Based Full DOF Hand Motion EstimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Random ForestsMachine Learning, 2001
- Pose space deformationPublished by Association for Computing Machinery (ACM) ,2000