Recovering 3D human body configurations using shape contexts
- 5 June 2006
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 28 (7), 1052-1062
- https://doi.org/10.1109/tpami.2006.149
Abstract
The problem we consider in this paper is to take a single two-dimensional image containing a human figure, locate the joint positions, and use these to estimate the body configuration and pose in three-dimensional space. The basic approach is to store a number of exemplar 2D views of the human body in a variety of different configurations and viewpoints with respect to the camera. On each of these stored views, the locations of the body joints (left elbow, right knee, etc.) are manually marked and labeled for future use. The input image is then matched to each stored view, using the technique of shape context matching in conjunction with a kinematic chain-based deformation model. Assuming that there is a stored view sufficiently similar in configuration and pose, the correspondence process would succeed. The locations of the body joints are then transferred from the exemplar view to the test shape. Given the 2D joint locations, the 3D body configuration and pose are then estimated using an existing algorithm. We can apply this technique to video by treating each frame independently - tracking just becomes repeated recognition. We present results on a variety of data setsKeywords
This publication has 32 references indexed in Scilit:
- Unsupervised learning of human motionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Fast pose estimation with parameter-sensitive hashingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Inferring 3D structure with a statistical image-based shape modelPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Using temporal coherence to build models of animalsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Ghost: a human body part labeling system using silhouettesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Probabilistic tracking in a metric spacePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Human tracking with mixtures of treesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Shadow puppetryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- Model-based vision: a program to see a walking personImage and Vision Computing, 1983
- Model-based image analysis of human motion using constraint propagationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1980