A Mirror-Based Active Vision System for Underwater Robots: From the Design to Active Object Tracking Application
Open Access
- 21 June 2021
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Robotics and AI
Abstract
A mirror-based active system capable of changing the view’s direction of a pre-existing fixed camera is presented. The aim of this research work is to extend the perceptual tracking capabilities of an underwater robot without altering its structure. The ability to control the view’s direction allows the robot to explore its entire surroundings without any actual displacement, which can be useful for more effective motion planning and for different navigation strategies, such as object tracking and/or obstacle evasion, which are of great importance for natural preservation in environments as complex and fragile as coral reefs. Active vision systems based on mirrors had been used mainly in terrestrial platforms to capture the motion of fast projectiles using high-speed cameras of considerable size and weight, but they had not been used on underwater platforms. In this sense, our approach incorporates a lightweight design adapted to an underwater robot using affordable and easy-access technology (i.e., 3D printing). Our active system consists of two arranged mirrors, one of which remains static in front of the robot’s camera, while the orientation of the second mirror is controlled by two servomotors. Object tracking is performed by using only the pixels contained on the homography of a defined area in the active mirror. HSV color space is used to reduce lighting change effects. Since color and geometry information of the tracking object are previously known, a window filter is applied over the H-channel for color blobs detection, then, noise is filtered and the object’s centroid is estimated. If the object is lost, a Kalman filter is applied to predict its position. Finally, with this information, an image PD controller computes the servomotor articular values. We have carried out experiments in real environments, testing our active vision system in an object-tracking application where an artificial object is manually displaced on the periphery of the robot and the mirror system is automatically reconfigured to keep such object focused by the camera, having satisfactory results in real time for detecting objects of low complexity and in poor lighting conditions.Funding Information
- Consejo Nacional de Ciencia y Tecnología (CB-2013-220540)
This publication has 17 references indexed in Scilit:
- MRF Model-Based Estimation of Camera Parameters and Detection of Underwater Moving ObjectsInternational Journal of Cognitive Informatics and Natural Intelligence, 2020
- Autonomous Development of Active Binocular and Motion Vision Through Active Efficient CodingFrontiers in Neurorobotics, 2019
- A Low-Cost Mirror-Based Active Perception System for Effective Collision Free Underwater Robotic NavigationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Quantitative underwater 3D motion analysis using submerged video cameras: accuracy analysis and trajectory reconstructionComputer Methods in Biomechanics and Biomedical Engineering, 2013
- Fast object detection based on color histograms and local binary patternsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- A theory of multi-layer flat refractive geometryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- High-speed gaze controller for millisecond-order pan/tilt cameraPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- The low distortion all-around view system using fisheye lens for an underwater vehiclePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Autonomous underwater vehicles for Ocean ExplorationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Quantitative photogrammetric analysis of digital underwater video imageryIEEE Journal of Oceanic Engineering, 1997