Learning to place new objects in a scene
- 14 May 2012
- journal article
- research article
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 31 (9), 1021-1043
- https://doi.org/10.1177/0278364912438781
Abstract
Placing is a necessary skill for a personal robot to have in order to perform tasks such as arranging objects in a disorganized room. The object placements should not only be stable but also be in their semantically preferred placing areas and orientations. This is challenging because an environment can have a large variety of objects and placing areas that may not have been seen by the robot before. In this paper, we propose a learning approach for placing multiple objects in different placing areas in a scene. Given point-clouds of the objects and the scene, we design appropriate features and use a graphical model to encode various properties, such as the stacking of objects, stability, object–area relationship and common placing constraints. The inference in our model is an integer linear program, which we solve efficiently via an linear programming relaxation. We extensively evaluate our approach on 98 objects from 16 categories being placed into 40 areas. Our robotic experiments show a success rate of 98% in placing known objects and 82% in placing new objects stably. We use our method on our robots for performing tasks such as loading several dish-racks, a bookshelf and a fridge with multiple items.Keywords
This publication has 59 references indexed in Scilit:
- Context-based search for 3D modelsACM Transactions on Graphics, 2010
- Spatial relationship preserving character motion adaptationACM Transactions on Graphics, 2010
- Using the forest to see the treesCommunications of the ACM, 2010
- Upright orientation of man-made objectsACM Transactions on Graphics, 2008
- Robotic Grasping of Novel Objects using VisionThe International Journal of Robotics Research, 2008
- 3-D Depth Reconstruction from a Single Still ImageInternational Journal of Computer Vision, 2007
- Heuristic algorithms for the three-dimensional bin packing problemEuropean Journal of Operational Research, 2002
- Using spin images for efficient object recognition in cluttered 3D scenesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- Support-vector networksMachine Learning, 1995
- On Computing Two-Finger Force-Closure Grasps of Curved 2D ObjectsThe International Journal of Robotics Research, 1993