Exploring Deep Reinforcement Learning for Holistic Smart Building Control

01/27/2023
by   Xianzhong Ding, et al.
0

In this paper, we take a holistic approach to deal with the tradeoffs between energy use and comfort in commercial buildings. We developed a system called OCTOPUS, which employs a novel deep reinforcement learning (DRL) framework that uses a data-driven approach to find the optimal control sequences of all building's subsystems, including HVAC, lighting, blind and window systems. The DRL architecture includes a novel reward function that allows the framework to explore the tradeoffs between energy use and users' comfort, while at the same time enabling the solution of the high-dimensional control problem due to the interactions of four different building subsystems. In order to cope with OCTOPUS's data training requirements, we argue that calibrated simulations that match the target building operational points are the vehicle to generate enough data to be able to train our DRL framework to find the control solution for the target building. In our work, we trained OCTOPUS with 10-year weather data and a building model that is implemented in the EnergyPlus building simulator, which was calibrated using data from a real production building. Through extensive simulations, we demonstrate that OCTOPUS can achieve 14.26 energy savings compared with the state-of-the-art rule-based method in a LEED Gold Certified building and the latest DRL-based method available in the literature respectively, while maintaining human comfort within a desired range.

READ FULL TEXT

page 1

page 6

research
10/26/2021

Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

It is estimated that about 40 commercial buildings can be attributed to ...
research
08/09/2020

One for Many: Transfer Learning for Building HVAC Control

The design of building heating, ventilation, and air conditioning (HVAC)...
research
06/23/2023

Energy Optimization for HVAC Systems in Multi-VAV Open Offices: A Deep Reinforcement Learning Approach

With more than 32 buildings, there is an urgent need to revisit traditio...
research
05/10/2018

Deep Reinforcement Learning for Optimal Control of Space Heating

Classical methods to control heating systems are often marred by subopti...
research
07/18/2021

Co-designing Intelligent Control of Building HVACs and Microgrids

Building loads consume roughly 40 countries, a significant part of which...
research
07/13/2020

Reinforcement Learning of Musculoskeletal Control from Functional Simulations

To diagnose, plan, and treat musculoskeletal pathologies, understanding ...

Please sign up or login with your details

Forgot password? Click here to reset