From 3D scene geometry to human workspace
- 1 June 2011
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1961-1968
- https://doi.org/10.1109/cvpr.2011.5995448
Abstract
We present a human-centric paradigm for scene understanding. Our approach goes beyond estimating 3D scene geometry and predicts the "workspace" of a human which is represented by a data-driven vocabulary of human interactions. Our method builds upon the recent work in indoor scene understanding and the availability of motion capture data to create a joint space of human poses and scene geometry by modeling the physical interactions between the two. This joint space can then be used to predict potential human poses and joint locations from a single image. In a way, this work revisits the principle of Gibsonian affordances, reinterpreting it for the modern, data-driven era.Keywords
This publication has 12 references indexed in Scilit:
- Modeling mutual context of object and human pose in human-object interaction activitiesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Recovering the spatial layout of cluttered roomsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Geometric reasoning for single image structure recoveryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Inferring spatial layout from a single image via depth-ordered groupingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Make3D: Learning 3D Scene Structure from a Single Still ImageIeee Transactions On Pattern Analysis and Machine Intelligence, 2008
- Recovering Surface Layout from an ImageInternational Journal of Computer Vision, 2007
- Synthesizing animations of human manipulation tasksPublished by Association for Computing Machinery (ACM) ,2004
- Multiple View Geometry in Computer VisionPublished by Cambridge University Press (CUP) ,2004
- Recognition by Functional PartsComputer Vision and Image Understanding, 1995
- Achieving generalized object recognition through reasoning about association of function to structureIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991