Valuing knowledge, information and agency in Multi-agent Reinforcement Learning: a case study in smart buildings

03/09/2018
by   Hussain Kazmi, et al.
0

Increasing energy efficiency in buildings can reduce costs and emissions substantially. Historically, this has been treated as a local, or single-agent, optimization problem. However, many buildings utilize the same types of thermal equipment e.g. electric heaters and hot water vessels. During operation, occupants in these buildings interact with the equipment differently thereby driving them to diverse regions in the state-space. Reinforcement learning agents can learn from these interactions, recorded as sensor data, to optimize the overall energy efficiency. However, if these agents operate individually at a household level, they can not exploit the replicated structure in the problem. In this paper, we demonstrate that this problem can indeed benefit from multi-agent collaboration by making use of targeted exploration of the state-space allowing for better generalization. We also investigate trade-offs between integrating human knowledge and additional sensors. Results show that savings of over 40 use of either expert knowledge or additional sensors with no loss of occupant comfort. We find that such multi-agent systems comfortably outperform comparable single agent systems.

READ FULL TEXT

page 1

page 2

page 3

research
10/08/2018

Multi-agent Deep Reinforcement Learning for Zero Energy Communities

Advances in renewable energy generation and introduction of the governme...
research
11/21/2021

Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning

In this paper, multi-agent reinforcement learning is used to control a h...
research
01/04/2018

Deep Reinforcement Learning based Optimal Control of Hot Water Systems

Energy consumption for hot water production is a major draw in high effi...
research
09/19/2023

Multicopy Reinforcement Learning Agents

This paper examines a novel type of multi-agent problem, in which an age...
research
03/15/2023

MAHTM: A Multi-Agent Framework for Hierarchical Transactive Microgrids

Integrating variable renewable energy into the grid has posed challenges...
research
08/17/2020

Multi-Agent Coverage in Urban Environments

We study multi-agent coverage algorithms for autonomous monitoring and p...
research
03/06/2020

Smart Train Operation Algorithms based on Expert Knowledge and Reinforcement Learning

During recent decades, the automatic train operation (ATO) system has be...

Please sign up or login with your details

Forgot password? Click here to reset