VisualRank: Applying PageRank to Large-Scale Image Search
- 16 May 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 30 (11), 1877-1890
- https://doi.org/10.1109/tpami.2008.121
Abstract
Because of the relative ease in understanding and processing text, commercial image-search systems often rely on techniques that are largely indistinguishable from text search. Recently, academic studies have demonstrated the effectiveness of employing image-based features to provide either alternative or additional signals to use in this process. However, it remains uncertain whether such techniques will generalize to a large number of popular Web queries and whether the potential improvement to search quality warrants the additional computational cost. In this work, we cast the image-ranking problem into the task of identifying "authority" nodes on an inferred visual similarity graph and propose VisualRank to analyze the visual link structures among images. The images found to be "authorities" are chosen as those that answer the image-queries well. To understand the performance of such an approach in a real system, we conducted a series of large-scale experiments based on the task of retrieving images for 2,000 of the most popular products queries. Our experimental results show significant improvement, in terms of user satisfaction and relevancy, in comparison to the most recent Google image search results. Maintaining modest computational cost is vital to ensuring that this procedure can be used in practice; we describe the techniques required to make this system practical for large-scale deployment in commercial search engines.This publication has 32 references indexed in Scilit:
- Image retrievalACM Computing Surveys, 2008
- Learning Local Image DescriptorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- The Story Picturing Engine---a system for automatic text illustrationACM Transactions on Multimedia Computing, Communications, and Applications, 2006
- A performance evaluation of local descriptorsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Object class recognition by unsupervised scale-invariant learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Disconnected Operation Service in Mobile Grid ComputingLecture Notes in Computer Science, 2003
- Blobworld: image segmentation using expectation-maximization and its application to image queryingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Content-based image retrieval at the end of the early yearsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- NeTra: A toolbox for navigating large image databasesMultimedia Systems, 1999
- Bayesian Network ClassifiersMachine Learning, 1997