A Tutorial on Bayesian Optimization

07/08/2018
by   Peter I. Frazier, et al.
12

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic noise in function evaluations. It builds a surrogate for the objective and quantifies the uncertainty in that surrogate using a Bayesian machine learning technique, Gaussian process regression, and then uses an acquisition function defined from this surrogate to decide where to sample. In this tutorial, we describe how Bayesian optimization works, including Gaussian process regression and three common acquisition functions: expected improvement, entropy search, and knowledge gradient. We then discuss more advanced techniques, including running multiple function evaluations in parallel, multi-fidelity and multi-information source optimization, expensive-to-evaluate constraints, random environmental conditions, multi-task Bayesian optimization, and the inclusion of derivative information. We conclude with a discussion of Bayesian optimization software and future research directions in the field. Within our tutorial material we provide a generalization of expected improvement to noisy evaluations, beyond the noise-free setting where it is more commonly applied. This generalization is justified by a formal decision-theoretic argument, standing in contrast to previous ad hoc modifications.

READ FULL TEXT
research
06/03/2015

Bayesian optimization for materials design

We introduce Bayesian optimization, a technique developed for optimizing...
research
02/07/2020

Noisy-Input Entropy Search for Efficient Robust Bayesian Optimization

We consider the problem of robust optimization within the well-establish...
research
04/04/2017

Correcting boundary over-exploration deficiencies in Bayesian optimization with virtual derivative sign observations

Bayesian optimization () is a global optimization strategy designed to f...
research
05/11/2022

Probability Distribution of Hypervolume Improvement in Bi-objective Bayesian Optimization

This work provides the exact expression of the probability distribution ...
research
03/28/2023

qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimization

Preferential Bayesian optimization (PBO) is a framework for optimizing a...
research
03/23/2018

Bayesian Optimization with Expensive Integrands

We propose a Bayesian optimization algorithm for objective functions tha...
research
03/23/2022

Accelerating Bayesian Optimization for Biological Sequence Design with Denoising Autoencoders

Bayesian optimization is a gold standard for query-efficient continuous ...

Please sign up or login with your details

Forgot password? Click here to reset