Projective simulation for artificial intelligence
Open Access
- 15 May 2012
- journal article
- research article
- Published by Springer Science and Business Media LLC in Scientific Reports
- Vol. 2 (1), 400
- https://doi.org/10.1038/srep00400
Abstract
We propose a model of a learning agent whose interaction with the environment is governed by a simulation-based projection, which allows the agent to project itself into future situations before it takes real action. Projective simulation is based on a random walk through a network of clips, which are elementary patches of episodic memory. The network of clips changes dynamically, both due to new perceptual input and due to certain compositional principles of the simulation process. During simulation, the clips are screened for specific features which trigger factual action of the agent. The scheme is different from other, computational, notions of simulation, and it provides a new element in an embodied cognitive science approach to intelligent action and learning. Our model provides a natural route for generalization to quantum-mechanical operation and connects the fields of reinforcement learning and quantum computation.Keywords
Other Versions
This publication has 32 references indexed in Scilit:
- Projective simulation for artificial intelligenceScientific Reports, 2012
- Attracting the attention of a flyProceedings of the National Academy of Sciences of the United States of America, 2011
- Self-Organizing Sensorimotor Maps Plus Internal Motivations Yield Animal-Like BehaviorAdaptive Behavior, 2010
- Episodic Simulation of Future EventsAnnals of the New York Academy of Sciences, 2008
- A Sensorimotor Map: Modulating Lateral Interactions for Anticipation and PlanningNeural Computation, 2006
- A Sensorimotor Map: Modulating Lateral Interactions for Anticipation and PlanningNeural Computation, 2006
- Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learningArtificial Intelligence, 1999
- Model-based learning for mobile robot navigation from the dynamical systems perspectiveIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 1996
- Mental Imagery in the Child: A Study of the Development of Imaginal RepresentationBritish Journal of Educational Studies, 1971
- Cognitive maps in rats and men.Psychological Review, 1948