Deep Reinforcement Learning for Long Term Hydropower Production Scheduling

by   Signe Riemer-Sørensen, et al.

We explore the use of deep reinforcement learning to provide strategies for long term scheduling of hydropower production. We consider a use-case where the aim is to optimise the yearly revenue given week-by-week inflows to the reservoir and electricity prices. The challenge is to decide between immediate water release at the spot price of electricity and storing the water for later power production at an unknown price, given constraints on the system. We successfully train a soft actor-critic algorithm on a simplified scenario with historical data from the Nordic power market. The presented model is not ready to substitute traditional optimisation tools but demonstrates the complementary potential of reinforcement learning in the data-rich field of hydropower scheduling.



There are no comments yet.


page 1

page 3


A Learning-based Optimal Market Bidding Strategy for Price-Maker Energy Storage

Load serving entities with storage units reach sizes and performances th...

Reinforcement Learning based Condition-oriented Maintenance Scheduling for Flow Line Systems

Maintenance scheduling is a complex decision-making problem in the produ...

Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement Learning

In this letter, we address the problem of controlling energy storage sys...

Deep Reinforcement Learning for Dynamic Urban Transportation Problems

We explore the use of deep learning and deep reinforcement learning for ...

Buffer Pool Aware Query Scheduling via Deep Reinforcement Learning

In this extended abstract, we propose a new technique for query scheduli...

A graphical approach to carbon-efficient spot market scheduling for Power-to-X applications

In the Paris agreement of 2015, it was decided to reduce the CO2 emissio...

A deep reinforcement learning framework for allocating buyer impressions in e-commerce websites

We study the problem of allocating impressions to sellers in e-commerce ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.