Feature-Model-Guided Online Learning for Self-Adaptive Systems

07/22/2019
by   Andreas Metzger, et al.
0

A self-adaptive system can modify its own structure and behavior at runtime based on its perception of the environment, of itself and of its requirements. To develop a self-adaptive system, software developers codify knowledge about the system and its environment, as well as how adaptation actions impact on the system. However, the codified knowledge may be insufficient due to design time uncertainty, and thus a self-adaptive system may execute adaptation actions that do not have the desired effect. Online learning is an emerging approach to address design time uncertainty by employing machine learning at runtime. Online learning accumulates knowledge at runtime by, for instance, exploring not-yet executed adaptation actions. We address two specific problems with respect to online learning for self-adaptive systems. First, the number of possible adaptation actions can be very large. Existing online learning techniques randomly explore the possible adaptation actions, but this can lead to slow convergence of the learning process. Second, the possible adaptation actions can change as a result of system evolution. Existing online learning techniques are unaware of these changes and thus do not explore new adaptation actions, but explore adaptation actions that are no longer valid. We propose using feature models to give structure to the set of adaptation actions and thereby guide the exploration process during online learning. Experimental results involving four real-world systems suggest that considering the hierarchical structure of feature models may speed up convergence by 7.2 average. Considering the differences between feature models before and after an evolution step may speed up convergence by 64.6

READ FULL TEXT
research
10/12/2022

Explaining Online Reinforcement Learning Decisions of Self-Adaptive Systems

Design time uncertainty poses an important challenge when developing a s...
research
07/29/2019

An adaptive architecture for portability of greenhouse models

This work deals with the portability of greenhouse models, as we believe...
research
03/05/2018

SACRE: Supporting contextual requirements' adaptation in modern self-adaptive systems in the presence of uncertainty at runtime

Runtime uncertainty such as unpredictable resource unavailability, chang...
research
08/08/2016

Online Adaptation of Deep Architectures with Reinforcement Learning

Online learning has become crucial to many problems in machine learning....
research
01/24/2022

Online AutoML: An adaptive AutoML framework for online learning

Automated Machine Learning (AutoML) has been used successfully in settin...
research
05/06/2019

Taming Uncertainty in the Assurance Process of Self-Adaptive Systems: a Goal-Oriented Approach

Goals are first-class entities in a self-adaptive system (SAS) as they g...
research
08/10/2020

A Scalable Querying Scheme for Memory-efficient Runtime Models with History

Runtime models provide a snapshot of a system at runtime at a desired le...

Please sign up or login with your details

Forgot password? Click here to reset