Internal models in sensorimotor integration: perspectives from adaptive control theory
- 31 August 2005
- journal article
- review article
- Published by IOP Publishing in Journal of Neural Engineering
- Vol. 2 (3), S147-S163
- https://doi.org/10.1088/1741-2560/2/3/s01
Abstract
Internal models and adaptive controls are empirical and mathematical paradigms that have evolved separately to describe learning control processes in brain systems and engineering systems, respectively. This paper presents a comprehensive appraisal of the correlation between these paradigms with a view to forging a unified theoretical framework that may benefit both disciplines. It is suggested that the classic equilibrium-point theory of impedance control of arm movement is analogous to continuous gain-scheduling or high-gain adaptive control within or across movement trials, respectively, and that the recently proposed inverse internal model is akin to adaptive sliding control originally for robotic manipulator applications. Modular internal models' architecture for multiple motor tasks is a form of multi-model adaptive control. Stochastic methods, such as generalized predictive control, reinforcement learning, Bayesian learning and Hebbian feedback covariance learning, are reviewed and their possible relevance to motor control is discussed. Possible applicability of a Luenberger observer and an extended Kalman filter to state estimation problems-such as sensorimotor prediction or the resolution of vestibular sensory ambiguity-is also discussed. The important role played by vestibular system identification in postural control suggests an indirect adaptive control scheme whereby system states or parameters are explicitly estimated prior to the implementation of control. This interdisciplinary framework should facilitate the experimental elucidation of the mechanisms of internal models in sensorimotor systems and the reverse engineering of such neural mechanisms into novel brain-inspired adaptive control paradigms in future.Keywords
This publication has 72 references indexed in Scilit:
- Random presentation enables subjects to adapt to two opposing forces on the handNature Neuroscience, 2004
- The central nervous system stabilizes unstable dynamics by learning optimal impedanceNature, 2001
- An online parameter estimator for quick convergence and time-varying linear systemsIEEE Transactions on Automatic Control, 2000
- A model-independent definition of attractor behavior applicable to interactive tasksIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2000
- A Neural Substrate of Prediction and RewardScience, 1997
- Self-tuning Optimal Regulation of Respiratory Motor Output by Hebbian Covariance LearningNeural Networks, 1996
- Forward Models for Physiological Motor ControlNeural Networks, 1996
- Neural network control for a closed-loop System using Feedback-error-learningNeural Networks, 1993
- Inverse-dynamics model eye movement control by Purkinje cells in the cerebellumNature, 1993
- Adaptive sliding controller synthesis for non-linear systemsInternational Journal of Control, 1986