Impact of voice on emotional judgment of faces: An event‐related fMRI study
- 12 January 2006
- journal article
- Published by Wiley in Human Brain Mapping
- Vol. 27 (9), 707-714
- https://doi.org/10.1002/hbm.20212
Abstract
Emotional information can be conveyed by various means of communication, such as propositional content, speech intonation, facial expression, and gestures. Prior studies have demonstrated that inputs from one modality can alter perception in another modality. To evaluate the impact of emotional intonation on ratings of emotional faces, a behavioral study first was carried out. Second, functional magnetic resonance (fMRI) was used to identify brain regions that mediate crossmodal effects of emotional prosody on judgments of facial expressions. In the behavioral study, subjects rated fearful and neutral facial expressions as being more fearful when accompanied by a fearful voice as compared to the same facial expressions without concomitant auditory stimulus, whereas no such influence on rating of faces was found for happy voices. In the fMRI experiment, this shift in rating of facial expressions in presence of a fearfully spoken sentence was correlated with the hemodynamic response in the left amygdala extending into the periamygdaloid cortex, which suggests that crossmodal effects on cognitive judgments of emotional information are mediated via these neuronal structures. Furthermore, significantly stronger activations were found in the mid‐portion of the right fusiform gyrus during judgment of facial expressions in presence of fearful as compared to happy intonations, indicating that enhanced processing of faces within this region can be induced by the presence of threat‐related information perceived via the auditory modality. Presumably, these increased extrastriate activations correspond to enhanced alertness, whereas responses within the left amygdala modulate cognitive evaluation of emotional facial expressions. Hum Brain Mapp, 2006.Keywords
This publication has 45 references indexed in Scilit:
- The organization of projections from the amygdala to visual cortical areas TE and V1 in the macaque monkeyJournal of Comparative Neurology, 2005
- Brain activity underlying emotional valence and arousal: A response‐related fMRI studyHuman Brain Mapping, 2004
- Effects of Attention and Emotion on Face Processing in the Human Brain: An Event-Related fMRI StudyNeuron, 2001
- Explicit and implicit neural mechanisms for processing of social information from facial expressions: A functional magnetic resonance imaging studyHuman Brain Mapping, 2000
- Neural responses to facial and vocal expressions of fear and disgustProceedings Of The Royal Society B-Biological Sciences, 1998
- Response and Habituation of the Human Amygdala during Visual Processing of Facial ExpressionNeuron, 1996
- Facial Emotion Recognition after Bilateral Amygdala Damage: Differentially Severe Impairment of FearCognitive Neuropsychology, 1996
- The emotion probe: Studies of motivation and attention.American Psychologist, 1995
- Using confidence intervals in within-subject designsPsychonomic Bulletin & Review, 1994
- Measuring emotion: The self-assessment manikin and the semantic differentialJournal of Behavior Therapy and Experimental Psychiatry, 1994