Reinforcement Learning for Thermostatically Controlled Loads Control using Modelica and Python

05/09/2020
by   Oleh Lukianykhin, et al.
0

The aim of the project is to investigate and assess opportunities for applying reinforcement learning (RL) for power system control. As a proof of concept (PoC), voltage control of thermostatically controlled loads (TCLs) for power consumption regulation was developed using Modelica-based pipeline. The Q-learning RL algorithm has been validated for deterministic and stochastic initialization of TCLs. The latter modelling is closer to real grid behaviour, which challenges the control development, considering the stochastic nature of load switching. In addition, the paper shows the influence of Q-learning parameters, including discretization of state-action space, on the controller performance.

READ FULL TEXT

page 5

page 9

research
10/03/2022

Accelerate Reinforcement Learning with PID Controllers in the Pendulum Simulations

We propose a Proportional Integral Derivative (PID) controller-based coa...
research
12/08/2022

Reinforcement Learning for Resilient Power Grids

Traditional power grid systems have become obsolete under more frequent ...
research
09/18/2019

ModelicaGym: Applying Reinforcement Learning to Modelica Models

This paper presents ModelicaGym toolbox that was developed to employ Rei...
research
11/18/2020

Experimental Study on Reinforcement Learning-based Control of an Acrobot

We present computational and experimental results on how artificial inte...
research
07/12/2021

Reinforcement Learning based Proactive Control for Transmission Grid Resilience to Wildfire

Power grid operation subject to an extreme event requires decision-makin...
research
04/08/2021

ACERAC: Efficient reinforcement learning in fine time discretization

We propose a framework for reinforcement learning (RL) in fine time disc...
research
08/30/2020

Reinforcement Learning Based Penetration Testing of a Microgrid Control Algorithm

Microgrids (MGs) are small-scale power systems which interconnect distri...

Please sign up or login with your details

Forgot password? Click here to reset