Factorization for non-rigid and articulated structure using metric projections
- 1 June 2009
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2898-2905
- https://doi.org/10.1109/cvpr.2009.5206602
Abstract
This paper describes a new algorithm for recovering the 3D shape and motion of deformable and articulated objects purely from uncalibrated 2D image measurements using an iterative factorization approach. Most solutions to non-rigid and articulated structure from motion require metric constraints to be enforced on the motion matrix to solve for the transformation that upgrades the solution to metric space. While in the case of rigid structure the metric upgrade step is simple since the motion constraints are linear, deformability in the shape introduces non-linearities. In this paper we propose an alternating least-squares approach associated with a globally optimal projection step onto the manifold of metric constraints. An important advantage of this new algorithm is its ability to handle missing data which becomes crucial when dealing with real video sequences with self-occlusions. We show successful results of our algorithms on synthetic and real sequences of both deformable and articulated data.Keywords
This publication has 11 references indexed in Scilit:
- Estimating 3D shape from degenerate sequences with missing dataComputer Vision and Image Understanding, 2009
- Coarse-to-fine low-rank structure-from-motionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- A Factorization-Based Approach for Articulated Nonrigid Shape, Motion and Kinematic Chain Recovery From VideoIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Nonrigid Structure-from-Motion: Estimating Shape and Motion with Hierarchical PriorsIeee Transactions On Pattern Analysis and Machine Intelligence, 2008
- Non-rigid structure from motion using ranklet-based tracking and non-linear optimizationImage and Vision Computing, 2007
- A Closed-Form Solution to Non-Rigid Shape and Motion RecoveryInternational Journal of Computer Vision, 2006
- A Direct Method for 3D Factorization of Nonrigid Motion Observed in 2DPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Recovering non-rigid 3D shape from image streamsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Using SeDuMi 1.02, A Matlab toolbox for optimization over symmetric conesOptimization Methods and Software, 1999
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992