Electrophysiological evidence of illusory audiovisual speech percept in human infants
- 12 August 2008
- journal article
- research article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences of the United States of America
- Vol. 105 (32), 11442-11445
- https://doi.org/10.1073/pnas.0804275105
Abstract
How effortlessly and quickly infants acquire their native language remains one of the most intriguing questions of human development. Our study extends this question into the audiovisual domain, taking into consideration visual speech cues, which were recently shown to have more importance for young infants than previously anticipated [Weikum WM, Vouloumanos A, Navarra J, Soto-Faraco, S, Sebastian-Galles N, Werker JF (2007) Science 316:1159]. A particularly interesting phenomenon of audiovisual speech perception is the McGurk effect [McGurk H, MacDonald J (1976) Nature 264:746-748], an illusory speech percept resulting from integration of incongruent auditory and visual speech cues. For some phonemes, the human brain does not detect the mismatch between conflicting auditory and visual cues but automatically assimilates them into the closest legal phoneme, sometimes different from both auditory and visual ones. Measuring event-related brain potentials in 5-month-old infants, we demonstrate differential brain responses when conflicting auditory and visual speech cues can be integrated and when they cannot be fused into a single percept. This finding reveals a surprisingly early ability to perceive speech cross-modally and highlights the role of visual speech experience during early postnatal development in learning of the phonemes and phonotactics of the native language.Keywords
This publication has 29 references indexed in Scilit:
- Visual speech contributes to phonetic learning in 6-month-old infantsCognition, 2008
- Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusionNeuropsychologia, 2007
- A Domain-General Theory of the Development of Perceptual DiscriminationCurrent Directions in Psychological Science, 2007
- Processing acoustic change and novelty in newborn infantsEuropean Journal of Neuroscience, 2007
- The decline of cross-species intersensory perception in human infantsProceedings of the National Academy of Sciences of the United States of America, 2006
- Is Face Processing Species-Specific During the First Year of Life?Science, 2002
- Statistical Learning by 8-Month-Old InfantsScience, 1996
- Speed and cerebral correlates of syllable discrimination in infantsNature, 1994
- Cross-language speech perception: Evidence for perceptual reorganization during the first year of lifeInfant Behavior and Development, 1984
- Hearing lips and seeing voicesNature, 1976