The Pump Scheduling Problem: A Real-World Scenario for Reinforcement Learning

by   Henrique Donâncio, et al.
INSA Rouen Normandie

Deep Reinforcement Learning (DRL) has achieved remarkable success in scenarios such as games and has emerged as a potential solution for control tasks. That is due to its ability to leverage scalability and handle complex dynamics. However, few works have targeted environments grounded in real-world settings. Indeed, real-world scenarios can be challenging, especially when faced with the high dimensionality of the state space and unknown reward function. We release a testbed consisting of an environment simulator and demonstrations of human operation concerning pump scheduling of a real-world water distribution facility to facilitate research. The pump scheduling problem can be viewed as a decision process to decide when to operate pumps to supply water while limiting electricity consumption and meeting system constraints. To provide a starting point, we release a well-documented codebase, present an overview of some challenges that can be addressed and provide a baseline representation of the problem. The code and dataset are available at


page 1

page 2

page 3

page 4


Deep Reinforcement Learning for Long Term Hydropower Production Scheduling

We explore the use of deep reinforcement learning to provide strategies ...

Off-Dynamics Inverse Reinforcement Learning from Hetero-Domain

We propose an approach for inverse reinforcement learning from hetero-do...

Optimizing Irrigation Efficiency using Deep Reinforcement Learning in the Field

Agricultural irrigation is a significant contributor to freshwater consu...

A Temporal-Pattern Backdoor Attack to Deep Reinforcement Learning

Deep reinforcement learning (DRL) has made significant achievements in m...

Towards a reinforcement learning de novo genome assembler

The use of reinforcement learning has proven to be very promising for so...

A Scalable and Reproducible System-on-Chip Simulation for Reinforcement Learning

Deep Reinforcement Learning (DRL) underlies in a simulated environment a...

Please sign up or login with your details

Forgot password? Click here to reset