Motion Estimation from Image and Inertial Measurements
- 1 December 2004
- journal article
- other
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 23 (12), 1157-1195
- https://doi.org/10.1177/0278364904045593
Abstract
Cameras and inertial sensors are each good candidates for autonomous vehicle navigation, modeling from video, and other applications that require six-degrees-of-freedom motion estimation. However, these sensors are also good candidates to be deployed together, since each can be used to resolve the ambiguities in estimated motion that result from using the other modality alone. In this paper, we consider the specific problem of estimating sensor motion and other unknowns from image, gyro, and accelerometer measurements, in environments without known fiducials. This paper targets applications where external positions references such as global positioning are not available, and focuses on the use of small and inexpensive inertial sensors, for applications where weight and cost requirements preclude the use of precision inertial navigation systems. We present two algorithms for estimating sensor motion from image and inertial measurements. The first algorithm is a batch method, which produces estimates of the sensor motion, scene structure, and other unknowns using measurements from the entire observation sequence simultaneously. The second algorithm recovers sensor motion, scene structure, and other parameters recursively, and is suitable for use with long or “infinite” sequences, in which no feature is always visible. We evaluate the accuracy of the algorithms and their sensitivity to their estimation parameters using a sequence of four experiments. These experiments focus on cases where estimates from image or inertial measurements alone are poor, on the relative advantage of using inertial measurements and omni directional images, and on long sequences in which the percentage of the image sequence in which individual features are visible is low.Keywords
This publication has 8 references indexed in Scilit:
- Three-Dimensional Motion and Structure Estimation Using Inertial Sensors and Computer Vision for Augmented RealityPRESENCE: Virtual and Augmented Reality, 2002
- Robust structure from motion estimation using inertial dataJournal of the Optical Society of America A, 2001
- Probabilistic data association methods for tracking complex visual objectsIeee Transactions On Pattern Analysis and Machine Intelligence, 2001
- Reflective surfaces for panoramic imagingApplied Optics, 1997
- Transitory image sequences, asymptotic properties, and estimation of motion and structureIeee Transactions On Pattern Analysis and Machine Intelligence, 1997
- Recovering 3D Shape and Motion from Image Streams Using Nonlinear Least SquaresJournal of Visual Communication and Image Representation, 1994
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992
- Closed-form solution of absolute orientation using unit quaternionsJournal of the Optical Society of America A, 1987