Consensus Transfer Q-Learning for Decentralized Generation Command Dispatch Based on Virtual Generation Tribe
- 1 May 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Smart Grid
- Vol. 9 (3), 2152-2165
- https://doi.org/10.1109/TSG.2016.2607801
Abstract
This paper develops a consensus transfer Q-learning (CTQ) for decentralized generation command dispatch (GCD) of automatic generation control (AGC). A two-layer decentralized GCD based on virtual generation tribe (VGT) is adopted to resolve the course of dimension emerged in large-scale power systems. The leader of VGTs can calculate the generation command of each VGT through exchanging the Q-value matrices with its adjacent VGTs. In addition, a behavior transfer is employed into CTQ to exploit the prior knowledge of source tasks for a new optimization task according to their similarities, such that the algorithm convergence rate can be accelerated and the requirement of AGC period is satisfied. Case studies are carried out to evaluate the performance of CTQ for decentralized GCD on China southern power grid model.Keywords
Funding Information
- National Natural Science Foundation of China (51177051, 51477055)
- National Key Basic Research Program of China (2013CB228205)
This publication has 41 references indexed in Scilit:
- Transferring knowledge as heuristics in reinforcement learning: A case-based approachArtificial Intelligence, 2015
- Accelerating Multiagent Reinforcement Learning by Equilibrium TransferIEEE Transactions on Cybernetics, 2014
- Multi-source transfer ELM-based Q learningNeurocomputing, 2013
- ${{\cal Q} {\cal D}}$-Learning: A Collaborative Distributed Strategy for Multi-Agent Reinforcement Learning Through ${\rm Consensus} + {\rm Innovations}$IEEE Transactions on Signal Processing, 2013
- Multi-objective reinforcement learning based routing in cognitive radio networks: Walking in a random mazePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- A Survey on Transfer LearningIEEE Transactions on Knowledge and Data Engineering, 2009
- Learning all optimal policies with multiple criteriaPublished by Association for Computing Machinery (ACM) ,2008
- Real-time very short-term load prediction for power-system automatic generation controlIEEE Transactions on Control Systems Technology, 2001
- Markov games as a framework for multi-agent reinforcement learningPublished by Elsevier BV ,1994
- Understanding automatic generation controlIEEE Transactions on Power Systems, 1992