Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networks

10/27/2021
by   Jianhong Wang, et al.
0

This paper presents a problem in power networks that creates an exciting and yet challenging real-world scenario for application of multi-agent reinforcement learning (MARL). The emerging trend of decarbonisation is placing excessive stress on power distribution networks. Active voltage control is seen as a promising solution to relieve power congestion and improve voltage quality without extra hardware investment, taking advantage of the controllable apparatuses in the network, such as roof-top photovoltaics (PVs) and static var compensators (SVCs). These controllable apparatuses appear in a vast number and are distributed in a wide geographic area, making MARL a natural candidate. This paper formulates the active voltage control problem in the framework of Dec-POMDP and establishes an open-source environment. It aims to bridge the gap between the power community and the MARL community and be a drive force towards real-world applications of MARL algorithms. Finally, we analyse the special characteristics of the active voltage control problems that cause challenges (e.g. interpretability) for state-of-the-art MARL approaches, and summarise the potential directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/28/2022

MultiRoboLearn: An open-source Framework for Multi-robot Deep Reinforcement Learning

It is well known that it is difficult to have a reliable and robust fram...
research
07/06/2020

Consensus Multi-Agent Reinforcement Learning for Volt-VAR Control in Power Distribution Networks

Volt-VAR control (VVC) is a critical application in active distribution ...
research
06/08/2022

Stabilizing Voltage in Power Distribution Networks via Multi-Agent Reinforcement Learning with Transformer

The increased integration of renewable energy poses a slew of technical ...
research
01/06/2019

Optimal Network Control in Partially-Controllable Networks

The effectiveness of many optimal network control algorithms (e.g., Back...
research
02/01/2023

Off-the-Grid MARL: a Framework for Dataset Generation with Baselines for Cooperative Offline Multi-Agent Reinforcement Learning

Being able to harness the power of large, static datasets for developing...
research
09/08/2021

PowerGym: A Reinforcement Learning Environment for Volt-Var Control in Power Distribution Systems

We introduce PowerGym, an open-source reinforcement learning environment...
research
02/28/2017

Analysing Congestion Problems in Multi-agent Reinforcement Learning

Congestion problems are omnipresent in today's complex networks and repr...

Please sign up or login with your details

Forgot password? Click here to reset