Reinforcement Learning Output Feedback NN Control Using Deterministic Learning Technique
Top Cited Papers
- 11 December 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 25 (3), 635-641
- https://doi.org/10.1109/tnnls.2013.2292704
Abstract
In this brief, a novel adaptive-critic-based neural network (NN) controller is investigated for nonlinear pure-feedback systems. The controller design is based on the transformed predictor form, and the actor-critic NN control architecture includes two NNs, whereas the critic NN is used to approximate the strategic utility function, and the action NN is employed to minimize both the strategic utility function and the tracking error. A deterministic learning technique has been employed to guarantee that the partial persistent excitation condition of internal states is satisfied during tracking control to a periodic reference orbit. The uniformly ultimate boundedness of closed-loop signals is shown via Lyapunov stability analysis. Simulation results are presented to demonstrate the effectiveness of the proposed control.Keywords
Funding Information
- National Science Foundation of China (61304098, 61134004)
- Foundation of Key Laboratory of Autonomous Systems and Networked Control (Ministry of Education, China) (2012A04)
- EU FP-7 (PIIFR-GA-2010-910078-H2R) project
- NWPU Basic Research Funding (JC20120236)
This publication has 25 references indexed in Scilit:
- Finite-Approximation-Error-Based Optimal Control Approach for Discrete-Time Nonlinear SystemsIEEE Transactions on Cybernetics, 2013
- Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems using Online ApproximatorsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2012
- Direct adaptive NN control for a class of discrete-time nonlinear strict-feedback systemsNeurocomputing, 2010
- Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systemsNeural Networks, 2009
- Adaptive optimal control for continuous-time linear systems based on policy iterationAutomatica, 2009
- An ISS-modular approach for adaptive neural control of pure-feedback systemsAutomatica, 2006
- Learning From Neural ControlIEEE Transactions on Neural Networks, 2006
- A Self-Learning Call Admission Control Scheme for CDMA Cellular NetworksIEEE Transactions on Neural Networks, 2005
- Stable inversion for nonlinear systemsAutomatica, 1997
- A perceptron network for functional identification and control of nonlinear systemsIEEE Transactions on Neural Networks, 1993