Bayesian Optimization With Censored Response Data

10/07/2013
by   Frank Hutter, et al.
0

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data, where in some evaluations we only obtain a lower bound on the function value. The ability to handle such response data allows us to adaptively censor costly function evaluations in minimization problems where the cost of a function evaluation corresponds to the function value. One important application giving rise to such censored data is the runtime-minimizing variant of the algorithm configuration problem: finding settings of a given parametric algorithm that minimize the runtime required for solving problem instances from a given distribution. We demonstrate that terminating slow algorithm runs prematurely and handling the resulting right-censored observations can substantially improve the state of the art in model-based algorithm configuration.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/29/2020

Neural Model-based Optimization with Right-Censored Observations

In many fields of study, we only observe lower bounds on the true respon...
research
09/12/2018

PARyOpt: A software for Parallel Asynchronous Remote Bayesian Optimization

PARyOpt is a python based implementation of the Bayesian optimization ro...
research
05/22/2018

Optimization, fast and slow: optimally switching between local and Bayesian optimization

We develop the first Bayesian Optimization algorithm, BLOSSOM, which sel...
research
02/25/2012

Hybrid Batch Bayesian Optimization

Bayesian Optimization aims at optimizing an unknown non-convex/concave f...
research
06/05/2017

Ensemble Bayesian Optimization

Bayesian Optimization (BO) has been shown to be a very effective paradig...
research
11/18/2022

Model-based Causal Bayesian Optimization

How should we intervene on an unknown structural causal model to maximiz...
research
04/27/2020

MATE: A Model-based Algorithm Tuning Engine

In this paper, we introduce a Model-based Algorithm Turning Engine, name...

Please sign up or login with your details

Forgot password? Click here to reset