Pose search: Retrieving people using their pose
- 1 June 2009
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2009 IEEE Conference on Computer Vision and Pattern Recognition
Abstract
We describe a method for retrieving shots containing a particular 2D human pose from unconstrained movie and TV videos. The method involves first localizing the spatial layout of the head, torso and limbs in individual frames using pictorial structures, and associating these through a shot by tracking. A feature vector describing the pose is then constructed from the pictorial structure. Shots can be retrieved either by querying on a single frame with the desired pose, or through a pose classifier trained from a set of pose examples. Our main contribution is an effective system for retrieving people based on their pose, and in particular we propose and investigate several pose descriptors which are person, clothing, background and lighting independent. As a second contribution, we improve the performance over existing methods for localizing upper body layout on unconstrained video. We compare the spatial layout pose retrieval to a baseline method where poses are retrieved using a HOG descriptor. Performance is assessed on five episodes of the TV series 'Buffy the Vampire Slayer', and pose retrieval is demonstrated also on three Hollywood movies..Keywords
This publication has 22 references indexed in Scilit:
- Progressive search space reduction for human pose estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Action recognition by learning mid-level motion featuresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Human Action Recognition Using Distribution of Oriented Rectangular PatchesPublished by Springer Science and Business Media LLC ,2007
- Video parsing based on head tracking and face recognitionPublished by Association for Computing Machinery (ACM) ,2007
- Body Part Detection for Human Pose Estimation and TrackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Retrieving actions in moviesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Improvements of Object Detection Using Boosted HistogramsPublished by British Machine Vision Association and Society for Pattern Recognition ,2006
- Pedestrian Detection in Crowded ScenesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Pictorial Structures for Object RecognitionInternational Journal of Computer Vision, 2005
- Finding people by samplingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999