Perceptual Inference, Learning, and Attention in a Multisensory World
- 8 July 2021
- journal article
- review article
- Published by Annual Reviews in Annual Review of Neuroscience
- Vol. 44 (1), 449-473
- https://doi.org/10.1146/annurev-neuro-100120-085519
Abstract
Adaptive behavior in a complex, dynamic, and multisensory world poses some of the most fundamental computational challenges for the brain, notably inference, decision-making, learning, binding, and attention. We first discuss how the brain integrates sensory signals from the same source to support perceptual inference and decision-making by weighting them according to their momentary sensory uncertainties. We then show how observers solve the binding or causal inference problem—deciding whether signals come from common causes and should hence be integrated or else be treated independently. Next, we describe the multifarious interplay between multisensory processing and attention. We argue that attentional mechanisms are crucial to compute approximate solutions to the binding problem in naturalistic environments when complex time-varying signals arise from myriad causes. Finally, we review how the brain dynamically adapts multisensory processing to a changing world across multiple timescales. Expected final online publication date for the Annual Review of Neuroscience, Volume 44 is July 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.Keywords
This publication has 170 references indexed in Scilit:
- Normalization as a canonical neural computationNature Reviews Neuroscience, 2011
- Neural correlates of reliability-based cue weighting during multisensory integrationNature Neuroscience, 2011
- A normalization model of multisensory integrationNature Neuroscience, 2011
- The multifaceted interplay between attention and multisensory integrationTrends in Cognitive Sciences, 2010
- Multisensory guidance of orienting behaviorHearing Research, 2009
- Dynamics of attentional selection under conflict: Toward a rational Bayesian account.Journal of Experimental Psychology: Human Perception and Performance, 2009
- Probabilistic Population Codes for Bayesian Decision MakingNeuron, 2008
- Noise in the nervous systemNature Reviews Neuroscience, 2008
- Humans integrate visual and haptic information in a statistically optimal fashionNature, 2002
- Hearing lips and seeing voicesNature, 1976