ReLBOT: A Transfer Learning Approach to Minimize Reinforcement Learning Risks in Smart Buildings

04/30/2023
by   Mikhail Genkin, et al.
0

Smart buildings aim to optimize energy consumption by applying artificial intelligent algorithms. When a smart building is commissioned there is no historical data that could be used to train these algorithms. On-line Reinforcement Learning (RL) algorithms have shown significant promise, but their deployment carries a significant risk, because as the RL agent initially explores its action space it could cause significant discomfort to the building residents. In this paper we present ReLBOT, a new technique that uses transfer learning in conjunction with deep RL to transfer knowledge from an existing, optimized smart building, to the newly commissioning building, to reduce the adverse impact of the reinforcement learning agent's warm-up period. We demonstrate improvements of up to 6.2 times in the duration, and up to 132 times in prediction variance for the reinforcement learning agent's warm-up period.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/04/2020

A Relearning Approach to Reinforcement Learning for Control of Smart Buildings

This paper demonstrates that continual relearning of control policies us...
research
09/14/2022

Learning state correspondence of reinforcement learning tasks for knowledge transfer

Deep reinforcement learning has shown an ability to achieve super-human ...
research
03/06/2020

Smart Train Operation Algorithms based on Expert Knowledge and Reinforcement Learning

During recent decades, the automatic train operation (ATO) system has be...
research
10/03/2019

Running Alchemist on Cray XC and CS Series Supercomputers: Dask and PySpark Interfaces, Deployment Options, and Data Transfer Times

Newly developed interfaces for Python, Dask, and PySpark enable the use ...
research
06/28/2022

Zero-Shot Building Control

Heating and cooling systems in buildings account for 31 use, much of whi...
research
08/12/2022

Low Emission Building Control with Zero-Shot Reinforcement Learning

Heating and cooling systems in buildings account for 31% of global energ...
research
11/29/2019

Induction of Subgoal Automata for Reinforcement Learning

In this work we present ISA, a novel approach for learning and exploitin...

Please sign up or login with your details

Forgot password? Click here to reset