Neurocomputational models of basal ganglia function in learning, memory and choice
- 4 October 2008
- journal article
- review article
- Published by Elsevier BV in Behavioural Brain Research
- Vol. 199 (1), 141-156
- https://doi.org/10.1016/j.bbr.2008.09.029
Abstract
The basal ganglia (BG) are critical for the coordination of several motor, cognitive, and emotional functions and become dysfunctional in several pathological states ranging from Parkinson’s disease to Schizophrenia. Here we review principles developed within a neurocomputational framework of BG and related circuitry which provide insights into their functional roles in behavior. We focus on two classes of models: those that incorporate aspects of biological realism and constrained by functional principles, and more abstract mathematical models focusing on the higher level computational goals of the BG. While the former are arguably more “realistic”, the latter have a complementary advantage in being able to describe functional principles of how the system works in a relatively simple set of equations, but are less suited to making specific hypotheses about the roles of specific nuclei and neurophysiological processes. We review the basic architecture and assumptions of these models, their relevance to our understanding of the neurobiological and cognitive functions of the BG, and provide an update on the potential roles of biological details not explicitly incorporated in existing models. Empirical studies ranging from those in transgenic mice to dopaminergic manipulation, deep brain stimulation, and genetics in humans largely support model predictions and provide the basis for further refinement. Finally, we discuss possible future directions and possible ways to integrate different types of models.Keywords
This publication has 191 references indexed in Scilit:
- A phosphatase cascade by which rewarding stimuli control nucleosomal responseNature, 2008
- Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learningProceedings of the National Academy of Sciences of the United States of America, 2007
- Substantia nigra/ventral tegmental reward prediction error disruption in psychosisMolecular Psychiatry, 2007
- Gene–gene interaction associated with neural reward sensitivityProceedings of the National Academy of Sciences of the United States of America, 2007
- Cortical substrates for exploratory decisions in humansNature, 2006
- Learning and decision making in monkeys during a rock–paper–scissors gameCognitive Brain Research, 2005
- Reinforcement learning and decision making in monkeys during a competitive gameCognitive Brain Research, 2004
- How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccadesNeural Networks, 2003
- A Neural Substrate of Prediction and RewardScience, 1997
- A dopamine- and cyclic AMP-regulated phosphoprotein enriched in dopamine-innervated brain regionsNature, 1983