Event-Triggered Time-Varying Bayesian Optimization

08/23/2022
by   Paul Brunzema, et al.
0

We consider the problem of sequentially optimizing a time-varying objective function using time-varying Bayesian optimization (TVBO). Here, the key challenge is to cope with old data. Current approaches to TVBO require prior knowledge of a constant rate of change. However, the rate of change is usually neither known nor constant. We propose an event-triggered algorithm, ET-GP-UCB, that detects changes in the objective function online. The event-trigger is based on probabilistic uniform error bounds used in Gaussian process regression. The trigger automatically detects when significant change in the objective functions occurs. The algorithm then adapts to the temporal change by resetting the accumulated dataset. We provide regret bounds for ET-GP-UCB and show in numerical experiments that it is competitive with state-of-the-art algorithms even though it requires no knowledge about the temporal changes. Further, ET-GP-UCB outperforms these competitive baselines if the rate of change is misspecified and we demonstrate that it is readily applicable to various settings without tuning hyperparameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/22/2022

On Controller Tuning with Time-Varying Bayesian Optimization

Changing conditions or environments can cause system dynamics to vary ov...
research
02/11/2021

No-Regret Algorithms for Time-Varying Bayesian Optimization

In this paper, we consider the time-varying Bayesian optimization proble...
research
03/10/2020

Time-varying Gaussian Process Bandit Optimization with Non-constant Evaluation Time

The Gaussian process bandit is a problem in which we want to find a maxi...
research
10/21/2015

Optimization as Estimation with Gaussian Processes in Bandit Settings

Recently, there has been rising interest in Bayesian optimization -- the...
research
11/23/2018

Regret bounds for meta Bayesian optimization with an unknown Gaussian process prior

Bayesian optimization usually assumes that a Bayesian prior is given. Ho...
research
12/13/2016

Hybrid Repeat/Multi-point Sampling for Highly Volatile Objective Functions

A key drawback of the current generation of artificial decision-makers i...
research
12/13/2016

Towards Adaptive Training of Agent-based Sparring Partners for Fighter Pilots

A key requirement for the current generation of artificial decision-make...

Please sign up or login with your details

Forgot password? Click here to reset