DTAM: Dense tracking and mapping in real-time
- 1 November 2011
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2320-2327
- https://doi.org/10.1109/iccv.2011.6126513
Abstract
DTAM is a system for real-time camera tracking and reconstruction which relies not on feature extraction but dense, every pixel methods. As a single hand-held RGB camera flies over a static scene, we estimate detailed textured depth maps at selected keyframes to produce a surface patchwork with millions of vertices. We use the hundreds of images available in a video stream to improve the quality of a simple photometric data term, and minimise a global spatially regularised energy functional in a novel non-convex optimisation framework. Interleaved, we track the camera's 6DOF motion precisely by frame-rate whole image alignment against the entire dense model. Our algorithms are highly parallelisable throughout and DTAM achieves real-time performance using current commodity GPU hardware. We demonstrate that a dense model permits superior tracking performance under rapid motion compared to a state of the art method using features; and also show the additional usefulness of the dense model for real-time scene interaction in a physics-enhanced augmented reality application.Keywords
This publication has 9 references indexed in Scilit:
- Fast cost-volume filtering for visual correspondence and beyondPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to ImagingJournal of Mathematical Imaging and Vision, 2011
- Live dense reconstruction with a single moving cameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Some First-Order Algorithms for Total Variation Based Image RestorationJournal of Mathematical Imaging and Vision, 2009
- Parallel Tracking and Mapping for Small AR WorkspacesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Sampling the disparity space imageIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004
- Robust multi-sensor image alignmentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992