Inter-media hashing for large-scale retrieval from heterogeneous data sources
- 22 June 2013
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 785-796
- https://doi.org/10.1145/2463676.2465274
Abstract
In this paper, we present a new multimedia retrieval paradigm to innovate large-scale search of heterogenous multimedia data. It is able to return results of different media types from heterogeneous data sources, e.g., using a query image to retrieve relevant text documents or images from different data sources. This utilizes the widely available data from different sources and caters for the current users' demand of receiving a result list simultaneously containing multiple types of data to obtain a comprehensive understanding of the query's results. To enable large-scale inter-media retrieval, we propose a novel inter-media hashing (IMH) model to explore the correlations among multiple media types from different data sources and tackle the scalability issue. To this end, multimedia data from heterogeneous data sources are transformed into a common Hamming space, in which fast search can be easily implemented by XOR and bit-count operations. Furthermore, we integrate a linear regression model to learn hashing functions so that the hash codes for new data points can be efficiently generated. Experiments conducted on real-world large-scale multimedia datasets demonstrate the superiority of our proposed method compared with state-of-the-art techniques.Keywords
This publication has 26 references indexed in Scilit:
- Locality-sensitive hashing scheme based on dynamic collision countingPublished by Association for Computing Machinery (ACM) ,2012
- Multiple feature hashing for real-time large scale near-duplicate video retrievalPublished by Association for Computing Machinery (ACM) ,2011
- Tag localization with spatial correlations and joint group sparsityPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Efficient and accurate nearest neighbor and closest pair search in high-dimensional spaceACM Transactions on Database Systems, 2010
- Cross-media retrieval: state-of-the-art and open issuesInternational Journal of Multimedia Intelligence and Security, 2010
- NUS-WIDEPublished by Association for Computing Machinery (ACM) ,2009
- Image retrievalACM Computing Surveys, 2008
- Semantic manifold learning for image retrievalPublished by Association for Computing Machinery (ACM) ,2005
- iDistanceACM Transactions on Database Systems, 2005
- Canonical Correlation Analysis: An Overview with Application to Learning MethodsNeural Computation, 2004