Executive Function Assigns Value to Novel Goal-Congruent Outcomes
Open Access
- 7 July 2021
- journal article
- research article
- Published by Oxford University Press (OUP) in Cerebral Cortex
- Vol. 32 (1), 231-247
- https://doi.org/10.1093/cercor/bhab205
Abstract
People often learn from the outcomes of their actions, even when these outcomes do not involve material rewards or punishments. How does our brain provide this flexibility? We combined behavior, computational modeling, and functional neuroimaging to probe whether learning from abstract novel outcomes harnesses the same circuitry that supports learning from familiar secondary reinforcers. Behavior and neuroimaging revealed that novel images can act as a substitute for rewards during instrumental learning, producing reliable reward-like signals in dopaminergic circuits. Moreover, we found evidence that prefrontal correlates of executive control may play a role in shaping flexible responses in reward circuits. These results suggest that learning from novel outcomes is supported by an interplay between high-level representations in prefrontal cortex and low-level responses in subcortical reward circuits. This interaction may allow for human reinforcement learning over arbitrarily abstract reward functions.Funding Information
- National Institute of Mental Health (F32 MH119797, R01MH119383, R01MH124108, F32MH119796)
- Hellman Fellows Fund
This publication has 82 references indexed in Scilit:
- A Neural Signature of Hierarchical Reinforcement LearningNeuron, 2011
- Posterior cingulate cortex: adapting behavior to a changing worldTrends in Cognitive Sciences, 2011
- Model-Based Influences on Humans' Choices and Striatal Prediction ErrorsNeuron, 2011
- States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement LearningNeuron, 2010
- Instructional control of reinforcement learning: A behavioral and neurocomputational investigationBrain Research, 2009
- Circular analysis in systems neuroscience: the dangers of double dippingNature Neuroscience, 2009
- Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learningProceedings of the National Academy of Sciences of the United States of America, 2007
- A component based noise correction method (CompCor) for BOLD and perfusion based fMRINeuroImage, 2007
- Cortical substrates for exploratory decisions in humansNature, 2006
- Cortical Surface-Based Analysis: I. Segmentation and Surface ReconstructionNeuroImage, 1999