A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance Experiment
- 1 June 2001
- journal article
- Published by SAGE Publications in Adaptive Behavior
- Vol. 9 (2), 91-104
- https://doi.org/10.1177/105971230200900205
Abstract
We present a computational model of learned avoidance behavior in a one-way avoidance experiment. Our model employs the reinforcement learning paradigm and a temporal-difference algorithm to implement both classically conditioned and instrumentally conditioned components. The role of the classically conditioned component is to develop an expectation of future benefit that is a function of the learning system's state and action. Competition among the instrumentally conditioned components determines the overt behavior generated by the learning system. Our model displays, in simulation, the reduced latency of the avoidance behavior during learning with continuing trials and the resistance to extinction of the avoidance response. These results are consistent with experimentally observed animal behavior. Our model extends the traditional two-process learning mechanism of Mowrer by explicitly defining the mechanisms of proprioceptive feedback, an internal clock, and generalization over the action space.Keywords
This publication has 16 references indexed in Scilit:
- Escape, Avoidance, and Imitation: A Neural Network ApproachAdaptive Behavior, 1997
- A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental ConditioningAdaptive Behavior, 1993
- Dissociating the effects of altered dopaminergic function on performance and learningBrain Research Bulletin, 1989
- Adaptively timed conditioned responses and the cerebellum: A neural network approachBiological Cybernetics, 1989
- Learning to predict by the methods of temporal differencesMachine Learning, 1988
- The role of dopamine in locomotor activity and learningBrain Research Reviews, 1983
- ON A PARTICULAR FORM OF CONDITIONED REFLEXJournal of the Experimental Analysis of Behavior, 1969
- Is the Cerebellar Cortex a Biological Clock in the Millisecond Range?Progress in brain research, 1967
- THE ROLE OF TEMPORAL DISCRIMINATIONS IN THE REINFORCEMENT OF SIDMAN AVOIDANCE BEHAVIOR1Journal of the Experimental Analysis of Behavior, 1963
- Traumatic avoidance learning: the outcomes of several extinction procedures with dogs.The Journal of Abnormal and Social Psychology, 1953