Support Surface Prediction in Indoor Scenes
- 1 December 2013
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2013 IEEE International Conference on Computer Vision
- p. 2144-2151
- https://doi.org/10.1109/iccv.2013.266
Abstract
In this paper, we present an approach to predict the extent and height of supporting surfaces such as tables, chairs, and cabinet tops from a single RGBD image. We define support surfaces to be horizontal, planar surfaces that can physically support objects and humans. Given a RGBD image, our goal is to localize the height and full extent of such surfaces in 3D space. To achieve this, we created a labeling tool and annotated 1449 images with rich, complete 3D scene models in NYU dataset. We extract ground truth from the annotated dataset and developed a pipeline for predicting floor space, walls, the height and full extent of support surfaces. Finally we match the predicted extent with annotated scenes in training scenes and transfer the the support surface configuration from training scenes. We evaluate the proposed approach in our dataset and demonstrate its effectiveness in understanding scenes in 3D space.Keywords
This publication has 11 references indexed in Scilit:
- An interactive approach to semantic modeling of indoor scenes with an RGBD cameraACM Transactions on Graphics, 2012
- Efficient structured prediction for 3D indoor scene understandingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Learning to place new objects in a sceneThe International Journal of Robotics Research, 2012
- Beyond the Line of Sight: Labeling the Underlying SurfacesLecture Notes in Computer Science, 2012
- Data-Driven Scene Understanding from 3D ModelsPublished by British Machine Vision Association and Society for Pattern Recognition ,2012
- From 3D scene geometry to human workspacePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Recovering the spatial layout of cluttered roomsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Reconstructing building interiors from imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Geometric reasoning for single image structure recoveryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009