Multiclass recognition and part localization with humans in the loop
- 1 November 2011
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2524-2531
- https://doi.org/10.1109/iccv.2011.6126539
Abstract
We propose a visual recognition system that is designed for fine-grained visual categorization. The system is composed of a machine and a human user. The user, who is unable to carry out the recognition task by himself, is interactively asked to provide two heterogeneous forms of information: clicking on object parts and answering binary questions. The machine intelligently selects the most informative question to pose to the user in order to identify the object's class as quickly as possible. By leveraging computer vision and analyzing the user responses, the overall amount of human effort required, measured in seconds, is minimized. We demonstrate promising results on a challenging dataset of uncropped images, achieving a significant average reduction in human effort over previous methods.Keywords
This publication has 13 references indexed in Scilit:
- Articulated pose estimation with flexible mixtures-of-partsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Attribute-centric recognition for cross-category generalizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Attribute and simile classifiers for face verificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- A shape-based object class model for knowledge transferPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Describing objects by their attributesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Learning to detect unseen object classes by between-class attribute transferPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Dictionary-free categorization of very similar objects via stacked evidence treesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Automated Flower Classification over a Large Number of ClassesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Hybrid Generative-Discriminative Visual CategorizationInternational Journal of Computer Vision, 2007
- A maximum entropy framework for part-based texture and object recognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005