Markerless Motion Capture with unsynchronized moving cameras
- 1 June 2009
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
In this work we present an approach for markerless motion capture (MoCap) of articulated objects, which are recorded with multiple unsynchronized moving cameras. Instead of using fixed (and expensive) hardware synchronized cameras, this approach allows us to track people with off-the-shelf handheld video cameras. To prepare a sequence for motion capture, we first reconstruct the static background and the position of each camera using Structure-from-Motion (SfM). Then the cameras are registered to each other using the reconstructed static background geometry. Camera synchronization is achieved via the audio streams recorded by the cameras in parallel. Finally, a markerless MoCap approach is applied to recover positions and joint configurations of subjects. Feature tracks and dense background geometry are further used to stabilize the MoCap. The experiments show examples with highly challenging indoor and outdoor scenes.Keywords
This publication has 21 references indexed in Scilit:
- Vision-based human motion analysis: An overviewComputer Vision and Image Understanding, 2007
- Scaled Motion Dynamics for Markerless Motion CapturePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- A survey of advances in vision-based human motion capture and analysisComputer Vision and Image Understanding, 2006
- Three-Dimensional Shape Knowledge for Joint Image Segmentation and Pose TrackingInternational Journal of Computer Vision, 2006
- Camera network calibration from dynamic silhouettesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Visual Modeling with a Hand-Held CameraInternational Journal of Computer Vision, 2004
- Generative modeling for continuous non-linearly embedded visual inferencePublished by Association for Computing Machinery (ACM) ,2004
- A multi-modal approach for determining speaker location and focusPublished by Association for Computing Machinery (ACM) ,2003
- Cochannel speaker separation by harmonic enhancement and suppressionIEEE Transactions on Speech and Audio Processing, 1997
- An Algorithm for Least-Squares Estimation of Nonlinear ParametersJournal of the Society for Industrial and Applied Mathematics, 1963