Emotional Cues during Simultaneous Face and Voice Processing: Electrophysiological Insights
Open Access
- 22 February 2012
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 7 (2), e31001
- https://doi.org/10.1371/journal.pone.0031001
Abstract
Both facial expression and tone of voice represent key signals of emotional communication but their brain processing correlates remain unclear. Accordingly, we constructed a novel implicit emotion recognition task consisting of simultaneously presented human faces and voices with neutral, happy, and angry valence, within the context of recognizing monkey faces and voices task. To investigate the temporal unfolding of the processing of affective information from human face-voice pairings, we recorded event-related potentials (ERPs) to these audiovisual test stimuli in 18 normal healthy subjects; N100, P200, N250, P300 components were observed at electrodes in the frontal-central region, while P100, N170, P270 were observed at electrodes in the parietal-occipital region. Results indicated a significant audiovisual stimulus effect on the amplitudes and latencies of components in frontal-central (P200, P300, and N250) but not the parietal occipital region (P100, N170 and P270). Specifically, P200 and P300 amplitudes were more positive for emotional relative to neutral audiovisual stimuli, irrespective of valence, whereas N250 amplitude was more negative for neutral relative to emotional stimuli. No differentiation was observed between angry and happy conditions. The results suggest that the general effect of emotion on audiovisual processing can emerge as early as 200 msec (P200 peak latency) post stimulus onset, in spite of implicit affective processing task demands, and that such effect is mainly distributed in the frontal-central region.This publication has 75 references indexed in Scilit:
- Three stages of facial expression processing: ERP study with rapid serial visual presentationNeuroImage, 2010
- Endogenous attention selection during binocular rivalry at early stages of visual processingVision Research, 2009
- Audiovisual Non-Verbal Dynamic Faces Elicit Converging fMRI and ERP ResponsesBrain Topography, 2009
- Affective picture processing: An integrative review of ERP findingsBiological Psychology, 2008
- Event-related brain potential correlates of emotional face processingNeuropsychologia, 2007
- Neural responses elicited to face motion and vocalization pairingsNeuropsychologia, 2007
- Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusionNeuropsychologia, 2007
- Using Event Related Potentials to Explore Stages of Facial Affect Recognition Deficits in SchizophreniaSchizophrenia Bulletin, 2007
- Facial emotion recognition in schizophrenia:When and why does it go awry?Schizophrenia Research, 2007
- Multichannel detection of magnetic compound action fields with stimulation of the index and little fingersElectroencephalography and Clinical Neurophysiology/Electromyography and Motor Control, 1995