Controlling Commercial Cooling Systems Using Reinforcement Learning

by   Jerry Luo, et al.

This paper is a technical overview of DeepMind and Google's recent work on reinforcement learning for controlling commercial cooling systems. Building on expertise that began with cooling Google's data centers more efficiently, we recently conducted live experiments on two real-world facilities in partnership with Trane Technologies, a building management system provider. These live experiments had a variety of challenges in areas such as evaluation, learning from offline data, and constraint satisfaction. Our paper describes these challenges in the hope that awareness of them will benefit future applied RL work. We also describe the way we adapted our RL system to deal with these challenges, resulting in energy savings of approximately 9 respectively at the two live experiment sites.


page 1

page 9

page 10

page 13

page 14

page 17


GridLearn: Multiagent Reinforcement Learning for Grid-Aware Building Energy Management

Increasing amounts of distributed generation in distribution networks ca...

Reinforcement Learning in Time-Varying Systems: an Empirical Study

Recent research has turned to Reinforcement Learning (RL) to solve chall...

A Review of Reinforcement Learning for Autonomous Building Energy Management

The area of building energy management has received a significant amount...

Learning from Human Feedback: Challenges for Real-World Reinforcement Learning in NLP

Large volumes of interaction logs can be collected from NLP systems that...

Safe reinforcement learning for multi-energy management systems with known constraint functions

Reinforcement learning (RL) is a promising optimal control technique for...

The False Dawn: Reevaluating Google's Reinforcement Learning for Chip Macro Placement

Reinforcement learning (RL) for physical design of silicon chips in a Go...

Please sign up or login with your details

Forgot password? Click here to reset