Differential Involvement of EEG Oscillatory Components in Sameness versus Spatial-Relation Visual Reasoning Tasks
Open Access
- 31 December 2020
- journal article
- research article
- Published by Society for Neuroscience in eneuro
Abstract
The development of deep convolutional neural networks (CNNs) has recently led to great successes in computer vision, and CNNs have become de facto computational models of vision. However, a growing body of work suggests that they exhibit critical limitations on tasks beyond image categorization. Here, we study one such fundamental limitation, concerning the judgment of whether two simultaneously presented items are the same or different (SD) compared with a baseline assessment of their spatial relationship (SR). In both human subjects and artificial neural networks, we test the prediction that SD tasks recruit additional cortical mechanisms which underlie critical aspects of visual cognition that are not explained by current computational models. We thus recorded electroencephalography (EEG) signals from human participants engaged in the same tasks as the computational models. Importantly, in humans the two tasks were matched in terms of difficulty by an adaptive psychometric procedure; yet, on top of a modulation of evoked potentials (EPs), our results revealed higher activity in the low beta (16-24 Hz) band in the SD compared with the SR conditions. We surmise that these oscillations reflect the crucial involvement of additional mechanisms, such as working memory and attention, which are missing in current feed-forward CNNs.This publication has 47 references indexed in Scilit:
- Top-Down Beta Rhythms Support Selective Attention via Interlaminar Interaction: A ModelPLoS Computational Biology, 2013
- Alpha-band oscillations, attention, and controlled access to stored informationTrends in Cognitive Sciences, 2012
- Same–different categorization in ratsLearning & Memory, 2012
- Oscillations in the prefrontal cortex: a gateway to memory and attentionCurrent Opinion in Neurobiology, 2011
- EEG oscillations reflect visual short-term memory processes for the change detection in human facesNeuroImage, 2010
- Greater frontal-parietal synchrony at low gamma-band frequencies for inefficient than efficient visual search in human EEGInternational Journal of Psychophysiology, 2009
- Human cortical rhythms during visual delayed choice reaction time tasks: A high-resolution EEG study on normal agingBehavioural Brain Research, 2004
- Guided search: An alternative to the feature integration model for visual search.Journal of Experimental Psychology: Human Perception and Performance, 1989
- P300 and Recall in an Incidental Memory ParadigmPsychophysiology, 1986
- Quest: A Bayesian adaptive psychometric methodPerception & Psychophysics, 1983