Model-Free Cooperative Optimal Output Regulation for Linear Discrete-Time Multi-Agent Systems Using Reinforcement Learning
Open Access
- 24 May 2023
- journal article
- Published by Hindawi Limited in Mathematical Problems in Engineering
- Vol. 2023, 1-15
- https://doi.org/10.1155/2023/6350647
Abstract
In this paper, an off-policy model-free algorithm is presented for solving the cooperative optimal output regulation problem for linear discrete-time multi-agent systems. First, an adaptive distributed observer is designed for each follower to estimate the leader’s information. Then, a distributed feedback-feedforward controller is developed for each follower to solve the cooperative optimal output regulation problem utilizing the follower’s state information and the adaptive distributed observer. Based on the reinforcement learning method, an adaptive algorithm is presented to find the optimal feedback gains via online data collection from system trajectory. By designing a Sylvester map, the solution to the regulator equations is calculated via data collected from the optimal feedback gain design steps, and the feedforward control gain is found. Finally, an off-policy model-free algorithm is proposed to design the distributed feedback-feedforward controller for each follower to solve the cooperative optimal output regulation problem. A numerical example is given to verify the effectiveness of this proposed approach.Keywords
This publication has 29 references indexed in Scilit:
- Cooperative output regulation of discrete-time linear time-delay multi-agent systems under switching networkNeurocomputing, 2017
- The adaptive distributed observer approach to the cooperative output regulation of linear multi-agent systemsAutomatica, 2017
- Off-Policy Integral Reinforcement Learning Method to Solve Nonlinear Continuous-Time Multiplayer Nonzero-Sum GamesIEEE Transactions on Neural Networks and Learning Systems, 2016
- The Cooperative Output Regulation Problem of Discrete-Time Linear Multi-Agent Systems by the Adaptive Distributed ObserverIEEE Transactions on Automatic Control, 2016
- Synchronization of discrete-time multi-agent systems on graphs using Riccati designAutomatica, 2013
- Cooperative output regulation of linear multi-agent systems by output feedbackSystems & Control Letters, 2012
- Consensus and Cooperation in Networked Multi-Agent SystemsProceedings of the IEEE, 2007
- Coordination of groups of mobile autonomous agents using nearest neighbor rulesIEEE Transactions on Automatic Control, 2003
- Robust Autonomous GuidancePublished by Springer Science and Business Media LLC ,2003
- The Linear Multivariable Regulator ProblemSIAM Journal on Control and Optimization, 1977