Escape, Avoidance, and Imitation: A Neural Network Approach
- 1 June 1997
- journal article
- Published by SAGE Publications in Adaptive Behavior
- Vol. 6 (1), 63-129
- https://doi.org/10.1177/105971239700600103
Abstract
We present a real-time neural network that integrates classical and operant processes to describe how animals learn to escape and avoid an aversive stimulus either by trial and error or by imitation. It is assumed that through classical conditioning animals build an internal model of the environment and that through operant conditioning animals select from alternative responses. The internal model of the environment provides predictions of the aversive stimulus based on environmental stimuli and the animal's own responses, and these predictions are used to train the operant conditioning block to generate responses that minimize the aversive stimulus. Computer simulations show that the model correctly describes many of the features that characterize escape and avoidance. The network also is able to describe the imitation of a demonstrator by an observer. During the demonstration, a neural network representing the observer stores classical associations between environmental stimuli and the demonstrator's responses and aversive stimuli, and these associations serve to train the operant associations during the observer's performance. It is assumed that the demonstrator's responses evoke a representation of identical responses in the observer and that the demonstrator's unconditioned response to the aversive stimulus serves as an aversive reinforcer for the observer. The network contributes to a general theory of adaptive behavior and is relevant to the design of autonomous systems that learn either through trial and error or through imitation.Keywords
This publication has 73 references indexed in Scilit:
- Instrumental Responding following Reinforcer DevaluationThe Quarterly Journal of Experimental Psychology, 1981
- The extinction of shuttlebox avoidanceLearning and Motivation, 1971
- Species-specific defense reactions and avoidance learning.Psychological Review, 1970
- Extinction of avoidance responding through response prevention (flooding).Psychological Bulletin, 1970
- Extinction of an avoidance response following response prevention: Some parametric investigations.Canadian Journal of Psychology / Revue canadienne de psychologie, 1969
- Avoidance and escape learning: Simultaneous acquisition of different responses.Journal of Comparative and Physiological Psychology, 1969
- Near-goal punishment of avoidance runningPsychonomic Science, 1967
- Rapid Extinction of an Avoidance Response following a Period of Response Prevention in the Avoidance ApparatusPsychological Reports, 1966
- Traumatic avoidance learning: The effects of conditioned stimulus length in a free-responding situation.Journal of Comparative and Physiological Psychology, 1957
- Response strength as a function of drive level and amount of drive reduction.Journal of Experimental Psychology, 1953