Real-World Scene Representations in High-Level Visual Cortex: It's the Spaces More Than the Places
Open Access
- 18 May 2011
- journal article
- research article
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 31 (20), 7322-7333
- https://doi.org/10.1523/jneurosci.4588-10.2011
Abstract
Real-world scenes are incredibly complex and heterogeneous, yet we are able to identify and categorize them effortlessly. In humans, the ventral temporal parahippocampal place area (PPA) has been implicated in scene processing, but scene information is contained in many visual areas, leaving their specific contributions unclear. Although early theories of PPA emphasized its role in spatial processing, more recent reports of its function have emphasized semantic or contextual processing. Here, using functional imaging, we reconstructed the organization of scene representations across human ventral visual cortex by analyzing the distributed response to 96 diverse real-world scenes. We found that, although individual scenes could be decoded in both PPA and early visual cortex (EVC), the structure of representations in these regions was vastly different. In both regions, spatial rather than semantic factors defined the structure of representations. However, in PPA, representations were defined primarily by the spatial factor of expanse (open, closed) and in EVC primarily by distance (near, far). Furthermore, independent behavioral ratings of expanse and distance correlated strongly with representations in PPA and peripheral EVC, respectively. In neither region was content (manmade, natural) a major contributor to the overall organization. Furthermore, the response of PPA could not be used to decode the high-level semantic category of scenes even when spatial factors were held constant, nor could category be decoded across different distances. These findings demonstrate, contrary to recent reports, that the response PPA primarily reflects spatial, not categorical or contextual, aspects of real-world scenes.This publication has 59 references indexed in Scilit:
- A new neural framework for visuospatial processingNature Reviews Neuroscience, 2011
- Comparison of multivariate classifiers and response normalizations for pattern-information fMRINeuroImage, 2010
- Cortical representations of bodies and faces are strongest in commonly experienced configurationsNature Neuroscience, 2010
- Recognition of natural scenes from global properties: Seeing the forest without representing the treesCognitive Psychology, 2009
- Matching Categorical Object Representations in Inferior Temporal Cortex of Man and MonkeyNeuron, 2008
- Feedback of visual object information to foveal retinotopic cortexNature Neuroscience, 2008
- Parahippocampal and retrosplenial contributions to human spatial navigationTrends in Cognitive Sciences, 2008
- Identifying natural images from human brain activityNature, 2008
- The effect of scene context on episodic object recognition: Parahippocampal cortex mediates memory encoding and retrieval successHippocampus, 2007
- Only some spatial patterns of fMRI response are read out in task performanceNature Neuroscience, 2007