Bayesian Optimization With Censored Response Data

10/07/2013
by   Frank Hutter, et al.
0

Bayesian optimization (BO) aims to minimize a given blackbox function using a model that is updated whenever new evidence about the function becomes available. Here, we address the problem of BO under partially right-censored response data, where in some evaluations we only obtain a lower bound on the function value. The ability to handle such response data allows us to adaptively censor costly function evaluations in minimization problems where the cost of a function evaluation corresponds to the function value. One important application giving rise to such censored data is the runtime-minimizing variant of the algorithm configuration problem: finding settings of a given parametric algorithm that minimize the runtime required for solving problem instances from a given distribution. We demonstrate that terminating slow algorithm runs prematurely and handling the resulting right-censored observations can substantially improve the state of the art in model-based algorithm configuration.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

09/29/2020

Neural Model-based Optimization with Right-Censored Observations

In many fields of study, we only observe lower bounds on the true respon...
09/12/2018

PARyOpt: A software for Parallel Asynchronous Remote Bayesian Optimization

PARyOpt is a python based implementation of the Bayesian optimization ro...
05/22/2018

Optimization, fast and slow: optimally switching between local and Bayesian optimization

We develop the first Bayesian Optimization algorithm, BLOSSOM, which sel...
02/25/2012

Hybrid Batch Bayesian Optimization

Bayesian Optimization aims at optimizing an unknown non-convex/concave f...
05/24/2022

Advanced Manufacturing Configuration by Sample-efficient Batch Bayesian Optimization

We propose a framework for the configuration and operation of expensive-...
06/05/2017

Ensemble Bayesian Optimization

Bayesian Optimization (BO) has been shown to be a very effective paradig...
03/22/2021

If You Must Choose Among Your Children, Pick the Right One

Given a simplicial complex K and an injective function f from the vertic...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.