Model-Based 3D Hand Pose Estimation from Monocular Video
Top Cited Papers
- 24 February 2011
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 33 (9), 1793-1805
- https://doi.org/10.1109/tpami.2011.33
Abstract
A novel model-based approach to 3D hand tracking from monocular video is presented. The 3D hand pose, the hand texture, and the illuminant are dynamically estimated through minimization of an objective function. Derived from an inverse problem formulation, the objective function enables explicit use of temporal texture continuity and shading information while handling important self-occlusions and time-varying illumination. The minimization is done efficiently using a quasi-Newton method, for which we provide a rigorous derivation of the objective function gradient. Particular attention is given to terms related to the change of visibility near self-occlusion boundaries that are neglected in existing formulations. To this end, we introduce new occlusion forces and show that using all gradient terms greatly improves the performance of the method. Qualitative and quantitative experimental results demonstrate the potential of the approach.Keywords
This publication has 20 references indexed in Scilit:
- A variational approach to monocular hand-pose estimationComputer Vision and Image Understanding, 2010
- Beyond pairwise energies: Efficient optimization for higher-order MRFsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface MeshesPublished by British Machine Vision Association and Society for Pattern Recognition ,2008
- Minimizing the Reprojection Error in Surface Reconstruction from ImagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Visual Hand Tracking Using Nonparametric Belief PropagationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Discontinuity edge overdrawPublished by Association for Computing Machinery (ACM) ,2001
- Pose space deformationPublished by Association for Computing Machinery (ACM) ,2000
- Trust Region MethodsPublished by Society for Industrial & Applied Mathematics (SIAM) ,2000
- The A -buffer, an antialiased hidden surface methodACM SIGGRAPH Computer Graphics, 1984
- A Comparison of Antialiasing TechniquesIEEE Computer Graphics and Applications, 1981