Deep Reinforcement Learning-Based Voltage Control to Deal with Model Uncertainties in Distribution Networks
Open Access
- 1 August 2020
- Vol. 13 (15), 3928
- https://doi.org/10.3390/en13153928
Abstract
This paper addresses the voltage control problem in medium-voltage distribution networks. The objective is to cost-efficiently maintain the voltage profile within a safe range, in presence of uncertainties in both the future working conditions, as well as the physical parameters of the system. Indeed, the voltage profile depends not only on the fluctuating renewable-based power generation and load demand, but also on the physical parameters of the system components. In reality, the characteristics of loads, lines and transformers are subject to complex and dynamic dependencies, which are difficult to model. In such a context, the quality of the control strategy depends on the accuracy of the power flow representation, which requires to capture the non-linear behavior of the power network. Relying on the detailed analytical models (which are still subject to uncertainties) introduces a high computational power that does not comply with the real-time constraint of the voltage control task. To address this issue, while avoiding arbitrary modeling approximations, we leverage a deep reinforcement learning model to ensure an autonomous grid operational control. Outcomes show that the proposed model-free approach offers a promising alternative to find a compromise between calculation time, conservativeness and economic performance.This publication has 34 references indexed in Scilit:
- Probabilistic simulation framework for balanced and unbalanced low voltage networksInternational Journal of Electrical Power & Energy Systems, 2016
- Multi-Stage Optimization Based Automatic Voltage Control Systems Considering Wind Power Forecasting ErrorsIEEE Transactions on Power Systems, 2016
- Optimal reactive power control of DGs for voltage regulation of MV distribution systems using sensitivity analysis method and PSO algorithmInternational Journal of Electrical Power & Energy Systems, 2015
- Active Management of Low-Voltage Networks for Mitigating Overvoltages Due to Photovoltaic UnitsIEEE Transactions on Smart Grid, 2015
- A new approach based on the experimental design method for the improvement of the operational efficiency in Medium Voltage distribution networksInternational Journal of Electrical Power & Energy Systems, 2015
- Optimal Decentralized Voltage Control for Distribution Systems With Inverter-Based Distributed GeneratorsIEEE Transactions on Power Systems, 2013
- Multiagent-Based Reinforcement Learning for Optimal Reactive Power DispatchIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2012
- Optimal Coordination of Energy Resources With a Two-Stage Online Active ManagementIEEE Transactions on Industrial Electronics, 2011
- Centralized and Distributed Voltage Control: Impact on Distributed Generation PenetrationIEEE Transactions on Power Systems, 2007
- Reinforcement Learning for Reactive Power ControlIEEE Transactions on Power Systems, 2004