Cortical network underlying audiovisual semantic integration and modulation of attention: An fMRI and graph-based study
Open Access
- 23 August 2019
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 14 (8), e0221185
- https://doi.org/10.1371/journal.pone.0221185
Abstract
Many neuroimaging and electrophysiology studies have suggested that semantic integration as a high-level cognitive process involves various cortical regions and is modulated by attention. However, the cortical network specific to semantic integration and the modulatory mechanism of attention remain unclear. Here, we designed an fMRI experiment using “bimodal stimulus” to extract information regarding the cortical activation related to the effects of semantic integration with and without attention, and then analyzed the characteristics of the cortical network and the modulating effect of attention on semantic integration. To further investigate the related cortical regions, we constructed a functional brain network for processing attended AV stimuli to evaluate the nodal properties using a graph-based method. The results of the fMRI and graph-based analyses showed that the semantic integration with attention activated the anterior temporal lobe (ATL), temporoparietal junction (TPJ), and frontoparietal cortex, with the ATL showing the highest nodal degree and efficiency; in contrast, semantic integration without attention involved a relatively small cortical network, including the posterior superior temporal gyrus (STG), Heschl’s gyrus (HG), and precentral gyrus. These results indicated that semantic integration is a complex cognitive process that occurs not only in the attended condition but also in the unattended condition, and that attention could modulate the distribution of cortical networks related to semantic integration. We suggest that semantic integration with attention is a conscious process and needs a wide cortical network working together, in which the ATL plays the role of a central hub; in contrast, semantic integration without attention is a pre-attentive process and involves a relatively smaller cortical network, in which the HG may play an important role. Our study will provide valuable insights into semantic integration and will be useful for investigations on multisensory integration and attention mechanism at multiple processing stages and levels within the cortical hierarchy.Funding Information
- National Natural Science Foundation of China (61773076)
- National Natural Science Foundation of China (61806025)
- Jilin Scientific and Technological Development Program (20190302072GX)
- Jilin Scientific and Technological Development Program (20180519012JH)
- Scientific Research Project of Jilin Provincial Department of Education during the 13th Five-year Plan Period (JJKH20190597KJ)
- National Natural Science Foundation of China (31600882)
This publication has 62 references indexed in Scilit:
- The Structure of Cognition: Attentional Episodes in Mind and BrainNeuron, 2013
- The neurobiology of semantic memoryTrends in Cognitive Sciences, 2011
- Neuroanatomical dissociation for taxonomic and thematic knowledge in the human brainProceedings of the National Academy of Sciences of the United States of America, 2011
- The multifaceted interplay between attention and multisensory integrationTrends in Cognitive Sciences, 2010
- Category-Specific versus Category-General Semantic Impairment Induced by Transcranial Magnetic StimulationCurrent Biology, 2010
- Coherent concepts are computed in the anterior temporal lobesProceedings of the National Academy of Sciences of the United States of America, 2010
- Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processingNature Neuroscience, 2009
- Two cortical mechanisms support the integration of visual and auditory speech: A hypothesis and preliminary dataNeuroscience Letters, 2009
- Cortical Plasticity of Audio-Visual Object RepresentationsCerebral Cortex, 2008
- Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and JudgmentsNeuron, 2008