A temporal difference account of avoidance learning
- 1 January 2008
- journal article
- research article
- Published by Taylor & Francis Ltd in Network: Computation in Neural Systems
- Vol. 19 (2), 137-160
- https://doi.org/10.1080/09548980802192784
Abstract
Aversive processing plays a central role in human phobic fears and may also be important in some symptoms of psychosis. We developed a temporal-difference model of the conditioned avoidance response, an important experimental model for aversive learning which is also a central pharmacological model of psychosis. In the model, dopamine neurons reported outcomes that were better than the learner expected, typically coming from reaching safety states, and thus controlled the acquisition of a suitable policy. The model accounts for normal conditioned avoidance learning, the persistence of responding in extinction, and critical effects of dopamine blockade, notably that subjects experiencing shocks under dopamine blockade, and hence failing to avoid them, nevertheless develop avoidance responses when both shocks and dopamine blockade are subsequently removed. These postulated roles of dopamine in aversive learning can thus account for many of the effects of dopaminergic modulation seen in laboratory models of psychopathological processes.Keywords
This publication has 68 references indexed in Scilit:
- Persecutory delusions and the conditioned avoidance paradigm: Towards an integration of the psychology and biology of paranoiaCognitive Neuropsychiatry, 2007
- The Yin and Yang of dopamine release: a new perspectiveNeuropharmacology, 2007
- The neurobiology of punishmentNature Reviews Neuroscience, 2007
- Dopamine, prediction error and associative learning: A model-based accountNetwork: Computation in Neural Systems, 2006
- The use of acceptance and commitment therapy to prevent the rehospitalization of psychotic patients: A randomized controlled trial.Journal of Consulting and Clinical Psychology, 2002
- A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance ExperimentAdaptive Behavior, 2001
- Escape, Avoidance, and Imitation: A Neural Network ApproachAdaptive Behavior, 1997
- Forward Models for Physiological Motor ControlNeural Networks, 1996
- Escape-from-fear performance as affected by handling method and an additional CS-shock treatmentLearning & Behavior, 1980
- An opponent-process theory of motivation: I. Temporal dynamics of affect.Psychological Review, 1974