Neural Basis of Reinforcement Learning and Decision Making
- 21 July 2012
- journal article
- review article
- Published by Annual Reviews in Annual Review of Neuroscience
- Vol. 35 (1), 287-308
- https://doi.org/10.1146/annurev-neuro-062111-150512
Abstract
Reinforcement learning is an adaptive process in which an animal utilizes its previous experience to improve the outcomes of future choices. Computational theories of reinforcement learning play a central role in the newly emerging areas of neuroeconomics and decision neuroscience. In this framework, actions are chosen according to their value functions, which describe how much future reward is expected from each action. Value functions can be adjusted not only through reward and penalty, but also by the animal's knowledge of its current environment. Studies have revealed that a large proportion of the brain is involved in representing and updating value functions and using them to choose an action. However, how the nature of a behavioral task affects the neural mechanisms of reinforcement learning remains incompletely understood. Future studies should uncover the principles by which different computational elements of reinforcement learning are dynamically coordinated across the entire brain.Keywords
This publication has 148 references indexed in Scilit:
- Ventral striatum: a critical look at models of learning and evaluationCurrent Opinion in Neurobiology, 2011
- Multiplicity of control in the basal ganglia: computational roles of striatal subregionsCurrent Opinion in Neurobiology, 2011
- Prefrontal Cortex and Impulsive Decision MakingBiological Psychiatry, 2011
- Heterogeneous reward signals in prefrontal cortexCurrent Opinion in Neurobiology, 2010
- Probabilistic Population Codes for Bayesian Decision MakingNeuron, 2008
- Entrainment of Neocortical Neurons and Gamma Oscillations by the Hippocampal Theta RhythmNeuron, 2008
- Decision Making in Recurrent Neuronal CircuitsNeuron, 2008
- Prefrontal Coding of Temporally Discounted Values during Intertemporal ChoiceNeuron, 2008
- Value Representations in the Primate Striatum during Matching BehaviorNeuron, 2008
- Neural mechanism for stochastic behaviour during a competitive gameNeural Networks, 2006