Keyframe-based visual–inertial odometry using nonlinear optimization
Top Cited Papers
- 15 December 2014
- journal article
- research article
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 34 (3), 314-334
- https://doi.org/10.1177/0278364914554813
Abstract
Combining visual and inertial measurements has become popular in mobile robotics, since the two sensing modalities offer complementary characteristics that make them the ideal choice for accurate visual–inertial odometry or simultaneous localization and mapping (SLAM). While historically the problem has been addressed with filtering, advancements in visual estimation suggest that nonlinear optimization offers superior accuracy, while still tractable in complexity thanks to the sparsity of the underlying problem. Taking inspiration from these findings, we formulate a rigorously probabilistic cost function that combines reprojection errors of landmarks and inertial terms. The problem is kept tractable and thus ensuring real-time operation by limiting the optimization to a bounded window of keyframes through marginalization. Keyframes may be spaced in time by arbitrary intervals, while still related by linearized inertial terms. We present evaluation results on complementary datasets recorded with our custom-built stereo visual–inertial hardware that accurately synchronizes accelerometer and gyroscope measurements with imagery. A comparison of both a stereo and monocular version of our algorithm with and without online extrinsics estimation is shown with respect to ground truth. Furthermore, we compare the performance to an implementation of a state-of-the-art stochastic cloning sliding-window filter. This competitive reference implementation performs tightly coupled filtering-based visual–inertial odometry. While our approach declaredly demands more computation, we show its superior performance in terms of accuracy.Keywords
This publication has 45 references indexed in Scilit:
- iSAM2: Incremental smoothing and mapping using the Bayes treeThe International Journal of Robotics Research, 2012
- Pose estimation using linearized rotations and quaternion algebraActa Astronautica, 2011
- Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibrationThe International Journal of Robotics Research, 2010
- Sliding window filter with application to planetary landingJournal of Field Robotics, 2010
- Relative Pose Calibration Between Visual and Inertial SensorsThe International Journal of Robotics Research, 2007
- Real-time implementation of airborne inertial-SLAMRobotics and Autonomous Systems, 2007
- The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban StructuresThe International Journal of Robotics Research, 2006
- Motion Estimation from Image and Inertial MeasurementsThe International Journal of Robotics Research, 2004
- Three-Dimensional Motion and Structure Estimation Using Inertial Sensors and Computer Vision for Augmented RealityPRESENCE: Virtual and Augmented Reality, 2002
- Strapdown Inertial Navigation Integration Algorithm Design Part 2: Velocity and Position AlgorithmsJournal of Guidance, Control, and Dynamics, 1998