A Bayesian Approach for the Robust Optimisation of Expensive-To-Evaluate Functions

04/25/2019
by   Nicholas D. Sanders, et al.
22

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single, possible fragile, optimal design. Expensive black-box functions can be optimised effectively with Bayesian optimisation, where a Gaussian process is a popular choice as a prior over the expensive function. We propose a method for robust optimisation using Bayesian optimisation to find a region of design space in which the expensive function's performance is insensitive to the inputs whilst retaining a good quality. This is achieved by sampling realisations from a Gaussian process modelling the expensive function and evaluating the improvement for each realisation. The expectation of these improvements can be optimised cheaply with an evolutionary algorithm to determine the next location at which to evaluate the expensive function. We describe an efficient process to locate the optimum expected improvement. We show empirically that evaluating the expensive function at the location in the candidate sweet spot about which the model is most uncertain or at random yield the best convergence in contrast to exploitative schemes. We illustrate our method on six test functions in two, five, and ten dimensions, and demonstrate that it is able to outperform a state-of-the-art approach from the literature.

READ FULL TEXT

page 1

page 8

page 9

page 10

research
10/27/2014

Heteroscedastic Treed Bayesian Optimisation

Optimising black-box functions is important in many disciplines, such as...
research
04/17/2020

What do you Mean? The Role of the Mean Function in Bayesian Optimisation

Bayesian optimisation is a popular approach for optimising expensive bla...
research
02/21/2019

Bayesian optimisation under uncertain inputs

Bayesian optimisation (BO) has been a successful approach to optimise fu...
research
02/21/2019

Stable Bayesian Optimisation via Direct Stability Quantification

In this paper we consider the problem of finding stable maxima of expens...
research
12/05/2019

Ordinal Bayesian Optimisation

Bayesian optimisation is a powerful tool to solve expensive black-box pr...
research
03/20/2016

Multi-fidelity Gaussian Process Bandit Optimisation

In many scientific and engineering applications, we are tasked with the ...
research
09/19/2018

Bayesian functional optimisation with shape prior

Real world experiments are expensive, and thus it is important to reach ...

Please sign up or login with your details

Forgot password? Click here to reset