Noisy-Input Entropy Search for Efficient Robust Bayesian Optimization

02/07/2020
by   Lukas P. Fröhlich, et al.
0

We consider the problem of robust optimization within the well-established Bayesian optimization (BO) framework. While BO is intrinsically robust to noisy evaluations of the objective function, standard approaches do not consider the case of uncertainty about the input parameters. In this paper, we propose Noisy-Input Entropy Search (NES), a novel information-theoretic acquisition function that is designed to find robust optima for problems with both input and measurement noise. NES is based on the key insight that the robust objective in many cases can be modeled as a Gaussian process, however, it cannot be observed directly. We evaluate NES on several benchmark problems from the optimization literature and from engineering. The results show that NES reliably finds robust optima, outperforming existing methods from the literature on all benchmarks.

READ FULL TEXT
research
07/02/2020

BOSH: Bayesian Optimization by Sampling Hierarchically

Deployments of Bayesian Optimization (BO) for functions with stochastic ...
research
10/06/2022

Joint Entropy Search for Multi-objective Bayesian Optimization

Many real-world problems can be phrased as a multi-objective optimizatio...
research
07/08/2018

A Tutorial on Bayesian Optimization

Bayesian optimization is an approach to optimizing objective functions t...
research
06/12/2017

Dealing with Integer-valued Variables in Bayesian Optimization with Gaussian Processes

Bayesian optimization (BO) methods are useful for optimizing functions t...
research
06/26/2019

Modulated Bayesian Optimization using Latent Gaussian Process Models

We present an approach to Bayesian Optimization that allows for robust s...
research
05/09/2018

Dealing with Categorical and Integer-valued Variables in Bayesian Optimization with Gaussian Processes

Bayesian Optimization (BO) methods are useful for optimizing functions t...
research
06/21/2017

Constrained Bayesian Optimization with Noisy Experiments

Randomized experiments are the gold standard for evaluating the effects ...

Please sign up or login with your details

Forgot password? Click here to reset