Adaptive-Critic-Based Robust Trajectory Tracking of Uncertain Dynamics and Its Application to a Spring–Mass–Damper System
- 30 June 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 65 (1), 654-663
- https://doi.org/10.1109/tie.2017.2722424
Abstract
In this paper, the robust trajectory tracking design of uncertain nonlinear systems is investigated by virtue of a self-learning optimal control formulation. The primary novelty lies in that an effective learning based robust tracking control strategy is developed for nonlinear systems under a general uncertain environment. The augmented system construction is performed by combining the tracking error with the reference trajectory. Then, an improved adaptive critic technique, which does not depend on the initial stabilizing controller, is employed to solve the Hamilton- Jacobi-Bellman (HJB) equation with respect to the nominal augmented system. Using the obtained control law, the closed-loop form of the augmented system is built with stability proof. Moreover, the robust trajectory tracking performance is guaranteed via Lyapunov approach in theory and then through simulation demonstration, where an application to a practical spring-mass-damper system is included.Keywords
Funding Information
- Natural Science Foundation of Beijing Municipality (4162065)
- National Natural Science Foundation of China (U1501251)
- Tianjin Natural Science Foundation (14JCQNJC05400)
- Open Project Program
- The State Key Laboratory of Management and Control for Complex Systems (20170105)
- China Postdoctoral Science Foundation (2014M561559)
- Early Career Development Award of SKLMCCS
This publication has 28 references indexed in Scilit:
- Adaptive Actor–Critic Design-Based Integral Sliding-Mode Control for Partially Unknown Nonlinear Systems With Input DisturbancesIEEE Transactions on Neural Networks and Learning Systems, 2015
- Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamicsInternational Journal of Control, 2015
- $ {H}_{ {\infty }}$ Tracking Control of Completely Unknown Continuous-Time Systems via Off-Policy Reinforcement LearningIEEE Transactions on Neural Networks and Learning Systems, 2015
- Neural-Network-Based Online HJB Solution for Optimal Robust Guaranteed Cost Control of Continuous-Time Uncertain Nonlinear SystemsIEEE Transactions on Cybernetics, 2014
- Decentralized Adaptive Optimal Control of Large-Scale Systems With Application to Power SystemsIEEE Transactions on Industrial Electronics, 2014
- Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learningAutomatica, 2014
- Fixed-final-time optimal tracking control of input-affine nonlinear systemsNeurocomputing, 2014
- Robust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear SystemsIEEE Transactions on Neural Networks and Learning Systems, 2014
- ARIGUMA Code Analyzer: Efficient Variant Detection by Identifying Common Instruction Sequences in Malware FamiliesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problemAutomatica, 2010