Attenuated Directed Exploration during Reinforcement Learning in Gambling Disorder
Open Access
- 1 February 2021
- journal article
- research article
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 41 (11), 2512-2522
- https://doi.org/10.1523/JNEUROSCI.1607-20.2021
Abstract
Gambling disorder (GD) is a behavioral addiction associated with impairments in value-based decision-making and behavioral flexibility and might be linked to changes in the dopamine system. Maximizing long-term rewards requires a flexible trade -off between the exploitation of known options and the exploration of novel options for information gain. This exploration-exploitation trade-off is thought to depend on dopamine neurotransmission. We hypothesized that human gamblers would show a reduction in directed (uncertainty-based) exploration, accompanied by changes in brain activity in a fronto-parietal exploration-related network. Twenty-three frequent, non-treatment seeking gamblers and twenty-three healthy matched con-trols (all male) performed a four-armed bandit task during functional magnetic resonance imaging (fMRI). Computational modeling using hierarchical Bayesian parameter estimation revealed signatures of directed exploration, random exploration, and perseveration in both groups. Gamblers showed a reduction in directed exploration, whereas random exploration and perseveration were similar between groups. Neuroimaging revealed no evidence for group differences in neural representa-tions of basic task variables (expected value, prediction errors). Our hypothesis of reduced frontal pole (FP) recruitment in gamblers was not supported. Exploratory analyses showed that during directed exploration, gamblers showed reduced parietal cortex and substantia-nigra/ventral-tegmental-area activity. Cross-validated classification analyses revealed that connectivity in an exploration-related network was predictive of group status, suggesting that connectivity patterns might be more predictive of problem gambling than univariate effects. Findings reveal specific reductions of strategic exploration in gamblers that might be linked to altered processing in a fronto-parietal network and/or changes in dopamine neurotransmission implicated in GD.Funding Information
- Deutsche Forschungsgemeinschaft (PE1627/5-1)
This publication has 67 references indexed in Scilit:
- Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven ExplorationNeuron, 2012
- Counterfactual Choice and Learning in a Neural Network Centered on Human Lateral Frontopolar CortexPLoS Biology, 2011
- The Reward Circuit: Linking Primate Anatomy and Human ImagingNeuropsychopharmacology, 2009
- Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitationNature Neuroscience, 2009
- Bayesian model selection for group studiesNeuroImage, 2009
- Nonlinear dynamic causal models for fMRINeuroImage, 2008
- DSM-IV pathological gambling in the National Comorbidity Survey ReplicationPsychological Medicine, 2008
- Dopamine-dependent prediction errors underpin reward-seeking behaviour in humansNature, 2006
- Cortical substrates for exploratory decisions in humansNature, 2006
- The Fagerström Test for Nicotine Dependence: a revision of the Fagerstrom Tolerance QuestionnaireBritish Journal of Addiction, 1991