Feature Depth Observation for Image-based Visual Servoing: Theory and Experiments
- 1 October 2008
- journal article
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 27 (10), 1093-1116
- https://doi.org/10.1177/0278364908096706
Abstract
In the classical image-based visual servoing framework, error signals are directly computed from image feature parameters, allowing, in principle, control schemes to be obtained that need neither a complete three-dimensional (3D) model of the scene nor a perfect camera calibration. However, when the computation of control signals involves the interaction matrix, the current value of some 3D parameters is requiredfor each considered feature, and typically a rough approximation of this value is used. With reference to the case of a point feature, for which the relevant 3D parameter is the depth Z, we propose a visual servoing approach where Z is observed and made available for servoing. This is achieved by interpreting depth as an unmeasurable state with known dynamics, and by building a non-linear observer that asymptotically recovers the actual value of Z for the selected feature. A byproduct of our analysis is the rigorous characterization of camera motions that actually allow such observation. Moreover, in the case of a partially uncalibrated camera, it is possible to exploit complementary camera motions in order to preliminarily estimate the focal length without knowing Z. Simulations and experimental results are presented for a mobile robot with an on-board camera in order to illustrate the benefits of integrating the depth observation within classical visual servoing schemes.This publication has 21 references indexed in Scilit:
- Visual servo control. II. Advanced approaches [Tutorial]IEEE Robotics & Automation Magazine, 2007
- Image-based visual servoing schemes for nonholonomic mobile manipulatorsRobotica, 2007
- Visual servo control. I. Basic approachesIEEE Robotics & Automation Magazine, 2006
- Image Moments: A General and Useful Set of Features for Visual ServoingIEEE Transactions on Robotics, 2004
- Nonlinear controllability and stability analysis of adaptive image-based systemsIEEE Transactions on Robotics and Automation, 2001
- A new partitioned approach to image-based visual servo controlIEEE Transactions on Robotics and Automation, 2001
- Potential problems of stability and convergence in image-based and position-based visual servoingPublished by Springer Science and Business Media LLC ,1998
- A tutorial on visual servo controlIEEE Transactions on Robotics and Automation, 1996
- Structure from controlled motionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- A new approach to visual servoing in roboticsIEEE Transactions on Robotics and Automation, 1992