A Deep CNN-Based Framework For Enhanced Aerial Imagery Registration with Applications to UAV Geolocalization
- 1 June 2018
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1594-159410
- https://doi.org/10.1109/cvprw.2018.00201
Abstract
In this paper we present a novel framework for geolocalizing Unmanned Aerial Vehicles (UAVs) using only their onboard camera. The framework exploits the abundance of satellite imagery, along with established computer vision and deep learning methods, to locate the UAV in a satellite imagery map. It utilizes the contextual information extracted from the scene to attain increased geolocalization accuracy and enable navigation without the use of a Global Positioning System (GPS), which is advantageous in GPS-denied environments and provides additional enhancement to existing GPS-based systems. The framework inputs two images at a time, one captured using a UAV-mounted downlooking camera, and the other synthetically generated from the satellite map based on the UAV location within the map. Local features are extracted and used to register both images, a process that is performed recurrently to relate UAV motion to its actual map position, hence performing preliminary localization. A semantic shape matching algorithm is subsequently applied to extract and match meaningful shape information from both images, and use this information to improve localization accuracy. The framework is evaluated on two different datasets representing different geographical regions. Obtained results demonstrate the viability of proposed method and that the utilization of visual information can offer a promising approach for unconstrained UAV navigation and enable the aerial platform to be self-aware of its surroundings thus opening up new application domains or enhancing existing ones.Keywords
This publication has 45 references indexed in Scilit:
- GPS‐denied Indoor and Outdoor Monocular Vision Aided Navigation and Control of Unmanned AircraftJournal of Field Robotics, 2013
- Estimation, planning, and mapping for autonomous flight using an RGB-D camera in GPS-denied environmentsThe International Journal of Robotics Research, 2012
- THE ISPRS BENCHMARK ON URBAN OBJECT CLASSIFICATION AND 3D BUILDING RECONSTRUCTIONISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2012
- The Registration of UAV Down-Looking Aerial Images to Satellite Images with Image Entropy and EdgesLecture Notes in Computer Science, 2010
- Vision-Based Unmanned Aerial Vehicle Navigation Using Geo-Referenced InformationEURASIP Journal on Advances in Signal Processing, 2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Integrated position estimation using aerial image sequencesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Random sample consensusCommunications of the ACM, 1981
- Visual pattern recognition by moment invariantsIEEE Transactions on Information Theory, 1962