DeepAI AI Chat
Log In Sign Up

Gym-ANM: Reinforcement Learning Environments for Active Network Management Tasks in Electricity Distribution Systems

by   Robin Henry, et al.

Active network management (ANM) of electricity distribution networks include many complex stochastic sequential optimization problems. These problems need to be solved for integrating renewable energies and distributed storage into future electrical grids. In this work, we introduce Gym-ANM, a framework for designing reinforcement learning (RL) environments that model ANM tasks in electricity distribution networks. These environments provide new playgrounds for RL research in the management of electricity networks that do not require an extensive knowledge of the underlying dynamics of such systems. Along with this work, we are releasing an implementation of an introductory toy-environment, ANM6-Easy, designed to emphasize common challenges in ANM. We also show that state-of-the-art RL algorithms can already achieve good performance on ANM6-Easy when compared against a model predictive control (MPC) approach. Finally, we provide guidelines to create new Gym-ANM environments differing in terms of (a) the distribution network topology and parameters, (b) the observation space, (c) the modelling of the stochastic processes present in the system, and (d) a set of hyperparameters influencing the reward signal. Gym-ANM can be downloaded at


page 1

page 2

page 3

page 4


Reinforcement learning for Energies of the future and carbon neutrality: a Challenge Design

Current rapid changes in climate increase the urgency to change energy p...

LapGym – An Open Source Framework for Reinforcement Learning in Robot-Assisted Laparoscopic Surgery

Recent advances in reinforcement learning (RL) have increased the promis...

Distributed Ensembles of Reinforcement Learning Agents for Electricity Control

Deep Reinforcement Learning (or just "RL") is gaining popularity for ind...

Intelligent Replication Management for HDFS Using Reinforcement Learning

Storage systems for cloud computing merge a large number of commodity co...

PDDLGym: Gym Environments from PDDL Problems

We present PDDLGym, a framework that automatically constructs OpenAI Gym...

Code Repositories


Design Reinforcement Learning environments that model Active Network Management (ANM) tasks in electricity distribution networks.

view repo


Run MPC-based policies and train RL agents in gym-anm environments using implementations from Stable Baselines 3.

view repo