Spatial pyramid co-occurrence for image classification
- 1 November 2011
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1465-1472
- https://doi.org/10.1109/iccv.2011.6126403
Abstract
We describe a novel image representation termed spatial pyramid co-occurrence which characterizes both the photometric and geometric aspects of an image. Specifically, the co-occurrences of visual words are computed with respect to spatial predicates over a hierarchical spatial partitioning of an image. The representation captures both the absolute and relative spatial arrangement of the words and, through the choice and combination of the predicates, can characterize a variety of spatial relationships. Our representation is motivated by the analysis of overhead imagery such as from satellites or aircraft. This imagery generally does not have an absolute reference frame and thus the relative spatial arrangement of the image elements often becomes the key discriminating feature. We validate this hypothesis using a challenging ground truth image dataset of 21 land-use classes manually extracted from high-resolution aerial imagery. Our approach is shown to result in higher classification rates than a non-spatial bagof- visual-words approach as well as a popular approach for characterizing the absolute spatial arrangement of visual words, the spatial pyramid representation of Lazebnik et al. [7]. While our primary objective is analyzing overhead imagery, we demonstrate that our approach achieves state-of-the-art performance on the Graz-01 object class dataset and performs competitively on the 15 Scene dataset.Keywords
This publication has 10 references indexed in Scilit:
- In defense of Nearest-Neighbor based image classificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Integrated feature selection and higher-order spatial feature extraction for object categorizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Proximity Distribution Kernels for Geometric Context in Category RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Discriminative Object Class Models of Appearance and Shape by CorrelatonsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene CategoriesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- The pyramid match kernel: discriminative classification with sets of image featuresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Video Google: a text retrieval approach to object matching in videosPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Textural Features for Image ClassificationIEEE Transactions on Systems, Man, and Cybernetics, 1973
- A Computer Movie Simulating Urban Growth in the Detroit RegionEconomic Geography, 1970