Towards semantic fMRI neurofeedback: navigating among mental states using real-time representational similarity analysis
- 8 March 2021
- journal article
- research article
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 18 (4), 046015
- https://doi.org/10.1088/1741-2552/abecc3
Abstract
Objective: Real-time functional magnetic resonance imaging neurofeedback (rt-fMRI-NF) is a non-invasive MRI procedure allowing examined participants to learn to self-regulate brain activity by performing mental tasks. A novel two-step rt-fMRI-NF procedure is proposed whereby the feedback display is updated in real-time based on high-level representations of experimental stimuli (e.g. objects to imagine) via real-time representational similarity analysis of multi-voxel patterns of brain activity. Approach: In a localizer session, the stimuli become associated with anchored points on a two-dimensional representational space where distances approximate between-pattern (dis)similarities. In the NF session, participants modulate their brain response, displayed as a movable point, to engage in a specific neural representation. The developed method pipeline is verified in a proof-of-concept rt-fMRI-NF study at 7 Tesla involving a single healthy participant imagining concrete objects. Based on this data and artificial data sets with similar (simulated) spatio-temporal structure and variable (injected) signal and noise, the dependence on noise is systematically assessed. Main results: The participant in the proof-of-concept study exhibited robust activation patterns in the localizer session and managed to control the neural representation of a stimulus towards the selected target in the NF session. The offline analyses validated the rt-fMRI-NF results, showing that the rapid convergence to the target representation is noise-dependent. Significance: Our proof-of-concept study introduces a new NF method allowing the participant to navigate among different mental states. Compared to traditional NF designs (e.g. using a thermometer display to set the level of the neural signal), the proposed approach provides content-specific feedback to the participant and extra degrees of freedom to the experimenter enabling real-time control of the neural activity towards a target brain state without suggesting a specific mental strategy to the subject.This publication has 59 references indexed in Scilit:
- Connectivity-based neurofeedback: Dynamic causal modeling for real-time fMRINeuroImage, 2013
- Representational geometry: integrating cognition, computation, and the brainTrends in Cognitive Sciences, 2013
- Real-Time Self-Regulation of Emotion Networks in Patients with DepressionPLOS ONE, 2012
- Perceptual Learning Incepted by Decoded fMRI Neurofeedback Without Stimulus PresentationScience, 2011
- A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal CortexNeuron, 2011
- Large-scale automated synthesis of human functional neuroimaging dataNature Methods, 2011
- Multiplexed Echo Planar Imaging for Sub-Second Whole Brain FMRI and Fast Diffusion ImagingPLOS ONE, 2010
- Multiband multislice GE‐EPI at 7 tesla, with 16‐fold acceleration using partial parallel imaging with application to high spatial and temporal whole‐brain fMRIMagnetic Resonance in Medicine, 2010
- Matching Categorical Object Representations in Inferior Temporal Cortex of Man and MonkeyNeuron, 2008
- Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal CortexScience, 2001