Bayesian Optimization With Censored Response Data

by   Frank Hutter, et al.

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data, where in some evaluations we only obtain a lower bound on the function value. The ability to handle such response data allows us to adaptively censor costly function evaluations in minimization problems where the cost of a function evaluation corresponds to the function value. One important application giving rise to such censored data is the runtime-minimizing variant of the algorithm configuration problem: finding settings of a given parametric algorithm that minimize the runtime required for solving problem instances from a given distribution. We demonstrate that terminating slow algorithm runs prematurely and handling the resulting right-censored observations can substantially improve the state of the art in model-based algorithm configuration.



page 1

page 2

page 3

page 4


Neural Model-based Optimization with Right-Censored Observations

In many fields of study, we only observe lower bounds on the true respon...

PARyOpt: A software for Parallel Asynchronous Remote Bayesian Optimization

PARyOpt is a python based implementation of the Bayesian optimization ro...

Optimization, fast and slow: optimally switching between local and Bayesian optimization

We develop the first Bayesian Optimization algorithm, BLOSSOM, which sel...

Hybrid Batch Bayesian Optimization

Bayesian Optimization aims at optimizing an unknown non-convex/concave f...

Advanced Manufacturing Configuration by Sample-efficient Batch Bayesian Optimization

We propose a framework for the configuration and operation of expensive-...

Ensemble Bayesian Optimization

Bayesian Optimization (BO) has been shown to be a very effective paradig...

If You Must Choose Among Your Children, Pick the Right One

Given a simplicial complex K and an injective function f from the vertic...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.