TreeC: a method to generate interpretable energy management systems using a metaheuristic algorithm

04/17/2023
by   Julian Ruddick, et al.
0

Energy management systems (EMS) have classically been implemented based on rule-based control (RBC) and model predictive control (MPC) methods. Recent research are investigating reinforcement learning (RL) as a new promising approach. This paper introduces TreeC, a machine learning method that uses the metaheuristic algorithm covariance matrix adaptation evolution strategy (CMA-ES) to generate an interpretable EMS modeled as a decision tree. This method learns the decision strategy of the EMS based on historical data contrary to RBC and MPC approaches that are typically considered as non adaptive solutions. The decision strategy of the EMS is modeled as a decision tree and is thus interpretable contrary to RL which mainly uses black-box models (e.g. neural networks). The TreeC method is compared to RBC, MPC and RL strategies in two study cases taken from literature: (1) an electric grid case and (2) a household heating case. The results show that TreeC obtains close performances than MPC with perfect forecast in both cases and obtains similar performances to RL in the electrical grid case and outperforms RL in the household heating case. TreeC demonstrates a performant application of machine learning for energy management systems that is also fully interpretable.

READ FULL TEXT
research
05/25/2022

MAVIPER: Learning Decision Tree Policies for Interpretable Multi-Agent Reinforcement Learning

Many recent breakthroughs in multi-agent reinforcement learning (MARL) r...
research
11/17/2020

Explaining Conditions for Reinforcement Learning Behaviors from Real and Imagined Data

The deployment of reinforcement learning (RL) in the real world comes wi...
research
09/15/2021

Infusing model predictive control into meta-reinforcement learning for mobile robots in dynamic environments

The successful operation of mobile robots requires them to rapidly adapt...
research
12/18/2022

Empirical Analysis of AI-based Energy Management in Electric Vehicles: A Case Study on Reinforcement Learning

Reinforcement learning-based (RL-based) energy management strategy (EMS)...
research
11/11/2019

Driving Reinforcement Learning with Models

Over the years, Reinforcement Learning (RL) established itself as a conv...
research
04/03/2023

Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents

The operation of electricity grids has become increasingly complex due t...
research
04/12/2022

Harnessing Interpretable Machine Learning for Origami Feature Design and Pattern Selection

Engineering design of origami systems is challenging because comparing d...

Please sign up or login with your details

Forgot password? Click here to reset