Tie-line Power Adjustment Method Based on Proximal Policy Optimization Algorithm
Open Access
- 1 February 2021
- journal article
- research article
- Published by IOP Publishing in Journal of Physics: Conference Series
- Vol. 1754 (1), 012229
- https://doi.org/10.1088/1742-6596/1754/1/012229
Abstract
The tie-line power adjustment is an essential part of the power system operation state calculation. Various existing algorithms to solve the tie-line power adjustment problem are mainly implemented by introducing tie-line power equation constraints into conventional power flow calculations. Such methods have low calculation efficiency, not enough automation, and are prone to non-convergence in the power flow calculation. In this paper, the tie-line power adjustment problem is formulated as a Markov decision process, and the proximal policy optimization algorithm is introduced to optimize the decision policy. In order to enhance the effectiveness of the proposed method, a new deep neural network structure suitable for the proximal policy optimization algorithm is designed. The proposed method is verified with the IEEE 39-bus system.This publication has 8 references indexed in Scilit:
- Deep Reinforcement Learning-Based Tie-Line Power Adjustment Method for Power System Operation State CalculationIEEE Access, 2019
- Dynamic Voltage and Frequency Scaling in NoCs with Supervised and Reinforcement Learning TechniquesIEEE Transactions on Computers, 2018
- Review on the Research and Practice of Deep Learning and Reinforcement Learning in Smart GridsCSEE Journal of Power and Energy Systems, 2018
- The Role of Concentrating Solar Power Toward High Renewable Energy Penetrated Power SystemsIEEE Transactions on Power Systems, 2018
- Forecasting the High Penetration of Wind Power on Multiple Scales Using Multi-to-Multi MappingIEEE Transactions on Power Systems, 2017
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Optimal Demand Response Using Device-Based Reinforcement LearningIEEE Transactions on Smart Grid, 2015
- Machine-Learning Aided Optimal Customer Decisions for an Interactive Smart GridIEEE Systems Journal, 2014