Recurrent computations for visual pattern completion
Open Access
- 13 August 2018
- journal article
- research article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences of the United States of America
- Vol. 115 (35), 8835-8840
- https://doi.org/10.1073/pnas.1719397115
Abstract
Making inferences from partial information constitutes a critical aspect of cognition. During visual perception, pattern completion enables recognition of poorly visible or occluded objects. We combined psychophysics, physiology, and computational models to test the hypothesis that pattern completion is implemented by recurrent computations and present three pieces of evidence that are consistent with this hypothesis. First, subjects robustly recognized objects even when they were rendered <15% visible, but recognition was largely impaired when processing was interrupted by backward masking. Second, invasive physiological responses along the human ventral cortex exhibited visually selective responses to partially visible objects that were delayed compared with whole objects, suggesting the need for additional computations. These physiological delays were correlated with the effects of backward masking. Third, state-of-the-art feed-forward computational architectures were not robust to partial visibility. However, recognition performance was recovered when the model was augmented with attractor-based recurrent connectivity. The recurrent model was able to predict which images of heavily occluded objects were easier or harder for humans to recognize, could capture the effect of introducing a backward mask on recognition behavior, and was consistent with the physiological delays along the human ventral visual stream. These results provide a strong argument of plausibility for the role of recurrent computations in making visual inferences from partial information.Keywords
Funding Information
- HHS | NIH | National Eye Institute (R01EY026025)
- National Science Foundation (1231216)
This publication has 27 references indexed in Scilit:
- Rethinking the Inception Architecture for Computer VisionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Spatiotemporal Dynamics Underlying Object Completion in Human Ventral Visual CortexNeuron, 2014
- The Role of Visual Area V4 in the Discrimination of Partially Occluded ShapesJournal of Neuroscience, 2014
- Performance-optimized hierarchical models predict neural responses in higher visual cortexProceedings of the National Academy of Sciences of the United States of America, 2014
- Untangling invariant object recognitionTrends in Cognitive Sciences, 2007
- Transformation of shape information in the ventral pathwayCurrent Opinion in Neurobiology, 2007
- A quantitative theory of immediate visual recognitionProgress in Brain Research, 2007
- Time course of amodal completion revealed by a shape discrimination taskPsychonomic Bulletin & Review, 2001
- Hierarchical models of object recognition in cortexNature Neuroscience, 1999
- Visual Object RecognitionAnnual Review of Neuroscience, 1996