Reinforcement learning for Energies of the future and carbon neutrality: a Challenge Design

by   Gaëtan Serré, et al.

Current rapid changes in climate increase the urgency to change energy production and consumption management, to reduce carbon and other green-house gas production. In this context, the French electricity network management company RTE (Réseau de Transport d'Électricité) has recently published the results of an extensive study outlining various scenarios for tomorrow's French power management. We propose a challenge that will test the viability of such a scenario. The goal is to control electricity transportation in power networks, while pursuing multiple objectives: balancing production and consumption, minimizing energetic losses, and keeping people and equipment safe and particularly avoiding catastrophic failures. While the importance of the application provides a goal in itself, this challenge also aims to push the state-of-the-art in a branch of Artificial Intelligence (AI) called Reinforcement Learning (RL), which offers new possibilities to tackle control problems. In particular, various aspects of the combination of Deep Learning and RL called Deep Reinforcement Learning remain to be harnessed in this application domain. This challenge belongs to a series started in 2019 under the name "Learning to run a power network" (L2RPN). In this new edition, we introduce new more realistic scenarios proposed by RTE to reach carbon neutrality by 2050, retiring fossil fuel electricity production, increasing proportions of renewable and nuclear energy and introducing batteries. Furthermore, we provide a baseline using state-of-the-art reinforcement learning algorithm to stimulate the future participants.


Gym-ANM: Reinforcement Learning Environments for Active Network Management Tasks in Electricity Distribution Systems

Active network management (ANM) of electricity distribution networks inc...

Controlling earthquake-like instabilities using artificial intelligence

Earthquakes are lethal and costly. This study aims at avoiding these cat...

Gym-ANM: Open-source software to leverage reinforcement learning for power system management in research and education

Gym-ANM is a Python package that facilitates the design of reinforcement...

Reinforcement Learning for Battery Management in Dairy Farming

Dairy farming is a particularly energy-intensive part of the agriculture...

PowRL: A Reinforcement Learning Framework for Robust Management of Power Networks

Power grids, across the world, play an important societal and economical...

Reinforcement Learning Based Cooperative P2P Energy Trading between DC Nanogrid Clusters with Wind and PV Energy Resources

In order to replace fossil fuels with the use of renewable energy resour...

Reinforcement Learning for Electricity Network Operation

This paper presents the background material required for the Learning to...

Please sign up or login with your details

Forgot password? Click here to reset