Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making
Open Access
- 2 June 2020
- journal article
- research article
- Published by eLife Sciences Publications, Ltd in eLife
Abstract
Involvement of dopamine in regulating exploration during decision-making has long been hypothesized, but direct causal evidence in humans is still lacking. Here, we use a combination of computational modeling, pharmacological intervention and functional magnetic resonance imaging to address this issue. Thirty-one healthy male participants performed a restless four-armed bandit task in a within-subjects design under three drug conditions: 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist haloperidol, and placebo. Choices were best explained by an extension of an established Bayesian learning model accounting for perseveration, directed exploration and random exploration. Modeling revealed attenuated directed exploration under L-dopa, while neural signatures of exploration, exploitation and prediction error were unaffected. Instead, L-dopa attenuated neural representations of overall uncertainty in insula and dorsal anterior cingulate cortex. Our results highlight the computational role of these regions in exploration and suggest that dopamine modulates how this circuit tracks accumulating uncertainty during decision-making.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (PE1627/5-1)
This publication has 150 references indexed in Scilit:
- Prefrontal dopamine and behavioral flexibility: shifting from an “inverted-U” toward a family of functionsFrontiers in Neuroscience, 2013
- Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven ExplorationNeuron, 2012
- Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive ControlBiological Psychiatry, 2011
- The impact of prior risk experiences on subsequent risky decision-making: The role of the insulaNeuroImage, 2010
- Neurons in Posterior Cingulate Cortex Signal Exploratory Decisions in a Dynamic Multioption Choice TaskCurrent Biology, 2009
- How do you feel — now? The anterior insula and human awarenessNature Reviews Neuroscience, 2009
- A phosphatase cascade by which rewarding stimuli control nucleosomal responseNature, 2008
- Levodopa increases memory encoding and dopamine release in the striatum in the elderlyNeurobiology of Aging, 2008
- Dopamine-dependent prediction errors underpin reward-seeking behaviour in humansNature, 2006
- Cortical substrates for exploratory decisions in humansNature, 2006