Reinforcement Learning for Resilient Power Grids

12/08/2022

∙

Traditional power grid systems have become obsolete under more frequent and extreme natural disasters. Reinforcement learning (RL) has been a promising solution for resilience given its successful history of power grid control. However, most power grid simulators and RL interfaces do not support simulation of power grid under large-scale blackouts or when the network is divided into sub-networks. In this study, we proposed an updated power grid simulator built on Grid2Op, an existing simulator and RL interface, and experimented on limiting the action and observation spaces of Grid2Op. By testing with DDQN and SliceRDQN algorithms, we found that reduced action spaces significantly improve training performance and efficiency. In addition, we investigated a low-rank neural network regularization method for deep Q-learning, one of the most widely used RL algorithms, in this power grid control scenario. As a result, the experiment demonstrated that in the power grid simulation environment, adopting this method will significantly increase the performance of RL agents.

READ FULL TEXT

Reinforcement Learning for Resilient Power Grids

Reinforcement Learning for Thermostatically Controlled Loads Control using Modelica and Python

Action Set Based Policy Optimization for Safe Power Grid Management

Power Grid Cascading Failure Mitigation by Reinforcement Learning

Confidence Estimation Transformer for Long-term Renewable Energy Forecasting in Reinforcement Learning-based Power Grid Dispatching

Hacking Google reCAPTCHA v3 using Reinforcement Learning

Charging control of electric vehicles using contextual bandits considering the electrical distribution grid

Large-Scale Co-Simulation of Power Grid and Communication Network Models with Software in the Loop

Reinforcement Learning for Resilient Power Grids

Related Research

Reinforcement Learning for Thermostatically Controlled Loads Control using Modelica and Python

Action Set Based Policy Optimization for Safe Power Grid Management

Power Grid Cascading Failure Mitigation by Reinforcement Learning

Confidence Estimation Transformer for Long-term Renewable Energy Forecasting in Reinforcement Learning-based Power Grid Dispatching

Hacking Google reCAPTCHA v3 using Reinforcement Learning

Charging control of electric vehicles using contextual bandits considering the electrical distribution grid

Large-Scale Co-Simulation of Power Grid and Communication Network Models with Software in the Loop