REPTILE: A Proactive Real-Time Deep Reinforcement Learning Self-adaptive Framework

03/28/2022
by   Flavio Corradini, et al.
0

In this work a general framework is proposed to support the development of software systems that are able to adapt their behaviour according to the operating environment changes. The proposed approach, named REPTILE, works in a complete proactive manner and relies on Deep Reinforcement Learning-based agents to react to events, referred as novelties, that can affect the expected behaviour of the system. In our framework, two types of novelties are taken into account: those related to the context/environment and those related to the physical architecture itself. The framework, predicting those novelties before their occurrence, extracts time-changing models of the environment and uses a suitable Markov Decision Process to deal with the real-time setting. Moreover, the architecture of our RL agent evolves based on the possible actions that can be taken.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/05/2017

Learning to Design Games: Strategic Environments in Deep Reinforcement Learning

In typical reinforcement learning (RL), the environment is assumed given...
research
04/28/2019

Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement Learning

In this letter, we address the problem of controlling energy storage sys...
research
02/06/2021

An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism

Despite abundant negotiation strategies in literature, the complexity of...
research
12/28/2022

Towards automating Codenames spymasters with deep reinforcement learning

Although most reinforcement learning research has centered on competitiv...
research
03/15/2021

Reinforcement Learning with Algorithms from Probabilistic Structure Estimation

Reinforcement learning (RL) algorithms aim to learn optimal decisions in...
research
03/03/2019

Scaling up budgeted reinforcement learning

Can we learn a control policy able to adapt its behaviour in real time s...
research
09/11/2019

Correlation Priors for Reinforcement Learning

Many decision-making problems naturally exhibit pronounced structures in...

Please sign up or login with your details

Forgot password? Click here to reset