Fusing concept detection and geo context for visual search
- 5 June 2012
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM) in Proceedings of the 2nd ACM International Conference on Multimedia Retrieval - ICMR '12
Abstract
Given the proliferation of geo-tagged images, the question of how to exploit geo tags and the underlying geo context for visual search is emerging. Based on the observation that the importance of geo context varies over concepts, we propose a concept-based image search engine which fuses visual concept detection and geo context in a concept-dependent manner. Compared to individual content-based and geo-based concept detectors and their uniform combination, concept-dependent fusion shows improvements. Moreover, since the proposed search engine is trained on social-tagged images alone without the need of human interaction, it is flexible to cope with many concepts. Search experiments on 101 popular visual concepts justify the viability of the proposed solution. In particular, for 79 out of the 101 concepts, the learned weights yield improvements over the uniform weights, with a relative gain of at least 5% in terms of average precision.Keywords
This publication has 26 references indexed in Scilit:
- Tag recommendation for georeferenced photosPublished by Association for Computing Machinery (ACM) ,2011
- Multimodal fusion for multimedia analysis: a surveyMultimedia Systems, 2010
- Evaluating Color Descriptors for Object and Scene RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- How flickr helps us make sense of the worldPublished by Association for Computing Machinery (ACM) ,2007
- A note on Platt’s probabilistic outputs for support vector machinesMachine Learning, 2007
- Linear feature-based models for information retrievalInformation Retrieval Journal, 2007
- Evaluation campaigns and TRECVidPublished by Association for Computing Machinery (ACM) ,2006
- Generating summaries and visualization for large collections of geo-referenced photographsPublished by Association for Computing Machinery (ACM) ,2006
- To search or to label?Published by Association for Computing Machinery (ACM) ,2006
- Cumulated gain-based evaluation of IR techniquesACM Transactions on Information Systems, 2002