A Factorization-Based Approach for Articulated Nonrigid Shape, Motion and Kinematic Chain Recovery From Video
- 21 March 2008
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 30 (5), 865-877
- https://doi.org/10.1109/tpami.2007.70739
Abstract
Recovering articulated shape and motion, especially human body motion, from video is a challenging problem with a wide range of applications in medical study, sport analysis, animation, and so forth. Previous work on articulated motion recovery generally requires prior knowledge of the kinematic chain and usually does not concern the recovery of the articulated shape. The nonrigidity of some articulated part, for example, human body motion with nonrigid facial motion, is completely ignored. We propose a factorization-based approach to recover the shape, motion, and kinematic chain of an articulated object with nonrigid parts altogether directly from video sequences under a unified framework. The proposed approach is based on our modeling of the articulated nonrigid motion as a set of intersecting motion subspaces. A motion subspace is the linear subspace of the trajectories of an object. It can model a rigid or nonrigid motion. The intersection of two motion subspaces of linked parts models the motion of an articulated joint or axis. Our approach consists of algorithms for motion segmentation, kinematic chain building, and shape recovery. It handles outliers and can be automated. We test our approach through synthetic and real experiments and demonstrate how to recover an articulated structure with nonrigid parts via a single-view camera without prior knowledge of its kinematic chain.Keywords
This publication has 26 references indexed in Scilit:
- Tracking and modeling non-rigid objects with rank constraintsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Articulated Structure from Motion by FactorizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- A new GPCA algorithm for clustering subspaces by fitting, differentiating and dividing polynomialsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Generalized principal component analysis (GPCA)Published by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- A clustering technique for the identification of piecewise affine systemsAutomatica, 2003
- Reconstruction of articulated objects from point correspondences in a single uncalibrated imagePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Bayesian Model Estimation and Selection for Epipolar Geometry and Generic Manifold FittingInternational Journal of Computer Vision, 2002
- Covariance scaled sampling for monocular 3D body trackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- Segmentation using eigenvectors: a unifying viewPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992