Online AutoML: An adaptive AutoML framework for online learning

01/24/2022
by   Bilge Celik, et al.
0

Automated Machine Learning (AutoML) has been used successfully in settings where the learning task is assumed to be static. In many real-world scenarios, however, the data distribution will evolve over time, and it is yet to be shown whether AutoML techniques can effectively design online pipelines in dynamic environments. This study aims to automate pipeline design for online learning while continuously adapting to data drift. For this purpose, we design an adaptive Online Automated Machine Learning (OAML) system, searching the complete pipeline configuration space of online learners, including preprocessing algorithms and ensembling techniques. This system combines the inherent adaptation capabilities of online learners with the fast automated pipeline (re)optimization capabilities of AutoML. Focusing on optimization techniques that can adapt to evolving objectives, we evaluate asynchronous genetic programming and asynchronous successive halving to optimize these pipelines continually. We experiment on real and artificial data streams with varying types of concept drift to test the performance and adaptation capabilities of the proposed system. The results confirm the utility of OAML over popular online learning algorithms and underscore the benefits of continuous pipeline redesign in the presence of data drift.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/09/2020

Adaptation Strategies for Automated Machine Learning on Evolving Data

Automated Machine Learning (AutoML) systems have been shown to efficient...
research
03/09/2015

On the Intrinsic Limits to Representationally-Adaptive Machine-Learning

Online learning is a familiar problem setting within Machine-Learning in...
research
11/03/2009

Slow Learners are Fast

Online learning algorithms have impressive convergence properties when i...
research
07/22/2019

Feature-Model-Guided Online Learning for Self-Adaptive Systems

A self-adaptive system can modify its own structure and behavior at runt...
research
04/27/2020

Evolving Inborn Knowledge For Fast Adaptation in Dynamic POMDP Problems

Rapid online adaptation to changing tasks is an important problem in mac...
research
04/28/2022

Standardized Evaluation of Machine Learning Methods for Evolving Data Streams

Due to the unspecified and dynamic nature of data streams, online machin...
research
07/23/2013

Online Optimization in Dynamic Environments

High-velocity streams of high-dimensional data pose significant "big dat...

Please sign up or login with your details

Forgot password? Click here to reset