Cross-View Image Matching for Geo-Localization in Urban Environments
- 1 July 2017
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1998-2006
- https://doi.org/10.1109/cvpr.2017.216
Abstract
In this paper, we address the problem of cross-view image geo-localization. Specifically, we aim to estimate the GPS location of a query street view image by finding the matching images in a reference database of geo-tagged birds eye view images, or vice versa. To this end, we present a new framework for cross-view image geo-localization by taking advantage of the tremendous success of deep convolutional neural networks (CNNs) in image classification and object detection. First, we employ the Faster R-CNN to detect buildings in the query and reference images. Next, for each building in the query image, we retrieve the k nearest neighbors from the reference buildings using a Siamese network trained on both positive matching image pairs and negative pairs. To find the correct NN for each query building, we develop an efficient multiple nearest neighbors matching method based on dominant sets. We evaluate the proposed framework on a new dataset that consists of pairs of street view and birds eye view images. Experimental results show that the proposed method achieves better geo-localization accuracy than other approaches and is able to generalize to images at unseen locations.Keywords
This publication has 23 references indexed in Scilit:
- Geo-localization using Volumetric Representations of Overhead ImageryInternational Journal of Computer Vision, 2015
- Image Geo-Localization Based on MultipleNearest Neighbor Feature Matching UsingGeneralized GraphsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Ultra-wide Baseline Facade Matching for Geo-localizationLecture Notes in Computer Science, 2012
- Geo-localization of street views with aerial image databasesPublished by Association for Computing Machinery (ACM) ,2011
- Learning a Similarity Metric Discriminatively, with Application to Face VerificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Scale & Affine Invariant Interest Point DetectorsInternational Journal of Computer Vision, 2004
- A new graph-theoretic approach to clustering and segmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Generalized network design problemsEuropean Journal of Operational Research, 2003
- Recognition-by-components: A theory of human image understanding.Psychological Review, 1987