KinectFusion: Real-time dense surface mapping and tracking
Top Cited Papers
- 1 October 2011
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
We present a system for accurate real-time mapping of complex and arbitrary indoor scenes in variable lighting conditions, using only a moving low-cost depth camera and commodity graphics hardware. We fuse all of the depth data streamed from a Kinect sensor into a single global implicit surface model of the observed scene in real-time. The current sensor pose is simultaneously obtained by tracking the live depth frame relative to the global model using a coarse-to-fine iterative closest point (ICP) algorithm, which uses all of the observed depth data available. We demonstrate the advantages of tracking against the growing full surface model compared with frame-to-frame tracking, obtaining tracking and mapping results in constant time within room sized scenes with limited drift and high accuracy. We also show both qualitative and quantitative results relating to various aspects of our tracking and mapping system. Modelling of natural scenes, in real-time with only commodity sensor and GPU hardware, promises an exciting step forward in augmented reality (AR), in particular, it allows dense surfaces to be reconstructed in real-time, with a level of detail and robustness beyond any solution yet presented using passive computer vision.Keywords
This publication has 24 references indexed in Scilit:
- RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environmentsThe International Journal of Robotics Research, 2012
- DTAM: Dense tracking and mapping in real-timePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- KinectFusionPublished by Association for Computing Machinery (ACM) ,2011
- Live dense reconstruction with a single moving cameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Remarks on the implementation of the fast marching methodIMA Journal of Numerical Analysis, 2008
- Probabilistic visibility for multi-view stereoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Efficient estimation of 3D Euclidean distance fields from 2D range imagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Incremental mapping of large cyclic environmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Interactive ray tracing for isosurface renderingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Marching cubes: A high resolution 3D surface construction algorithmPublished by Association for Computing Machinery (ACM) ,1987