Few-Shot Object Detection on Remote Sensing Images
- 24 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892), 1-14
- https://doi.org/10.1109/tgrs.2021.3051383
Abstract
In this article, we deal with the problem of object detection on remote sensing images. Previous researchers have developed numerous deep convolutional neural network (CNN)-based methods for object detection on remote sensing images, and they have reported remarkable achievements in detection performance and efficiency. However, current CNN-based methods often require a large number of annotated samples to train deep neural networks and tend to have limited generalization abilities for unseen object categories. In this article, we introduce a metalearning-based method for few-shot object detection on remote sensing images where only a few annotated samples are needed for the unseen object categories. More specifically, our model contains three main components: a metafeature extractor that learns to extract metafeature maps from input images, a feature reweighting module that learns class-specific reweighting vectors from the support images and use them to recalibrate the metafeature maps, and a bounding box prediction module that carries out object detection on the reweighted feature maps. We build our few-shot object detection model upon the YOLOv3 architecture and develop a multiscale object detection framework. Experiments on two benchmark data sets demonstrate that with only a few annotated samples, our model can still achieve a satisfying detection performance on remote sensing images, and the performance of our model is significantly better than the well-established baseline models.Keywords
Other Versions
Funding Information
- Department of Education and Knowledge (AARE-18150)
- NYU Abu Dhabi Institute (AD131)
This publication has 65 references indexed in Scilit:
- Multi-class geospatial object detection and geographic image classification based on collection of part detectorsISPRS Journal of Photogrammetry and Remote Sensing, 2014
- VHR Object Detection Based on Structural Feature Extraction and Query ExpansionIEEE Transactions on Geoscience and Remote Sensing, 2014
- Contextual classification of lidar data and building object detection in urban areasISPRS Journal of Photogrammetry and Remote Sensing, 2014
- Multiobjective evolutionary algorithms to identify highly autocorrelated areas: the case of spatial distribution in financially compromised farmsAnnals of Operations Research, 2011
- The Pascal Visual Object Classes (VOC) ChallengeInternational Journal of Computer Vision, 2009
- Road centreline extraction from high‐resolution imagery based on multiscale structural features and support vector machinesInternational Journal of Remote Sensing, 2009
- Road tracking in aerial images based on human–computer interaction and Bayesian filteringISPRS Journal of Photogrammetry and Remote Sensing, 2006
- Towards automatic building extraction from high-resolution digital elevation modelsISPRS Journal of Photogrammetry and Remote Sensing, 1995
- Methods for exploiting the relationship between buildings and their shadows in aerial imageryIEEE Transactions on Systems, Man, and Cybernetics, 1989
- Detecting buildings in aerial imagesComputer Vision, Graphics, and Image Processing, 1988