What Makes an Effective Scalarising Function for Multi-Objective Bayesian Optimisation?

04/10/2021
by   Clym Stock-Williams, et al.
6

Performing multi-objective Bayesian optimisation by scalarising the objectives avoids the computation of expensive multi-dimensional integral-based acquisition functions, instead of allowing one-dimensional standard acquisition functions—such as Expected Improvement—to be applied. Here, two infill criteria based on hypervolume improvement—one recently introduced and one novel—are compared with the multi-surrogate Expected Hypervolume Improvement. The reasons for the disparities in these methods' effectiveness in maximising the hypervolume of the acquired Pareto Front are investigated. In addition, the effect of the surrogate model mean function on exploration and exploitation is examined: careful choice of data normalisation is shown to be preferable to the exploration parameter commonly used with the Expected Improvement acquisition function. Finally, the effectiveness of all the methodological improvements defined here is demonstrated on a real-world problem: the optimisation of a wind turbine blade aerofoil for both aerodynamic performance and structural stiffness. With effective scalarisation, Bayesian optimisation finds a large number of new aerofoil shapes that strongly dominate standard designs.

READ FULL TEXT

page 4

page 6

page 8

page 15

page 20

page 21

page 22

04/27/2022

R-MBO: A Multi-surrogate Approach for Preference Incorporation in Multi-objective Bayesian Optimisation

Many real-world multi-objective optimisation problems rely on computatio...
03/31/2022

Wind Farm Layout Optimisation using Set Based Multi-objective Bayesian Optimisation

Wind energy is one of the cleanest renewable electricity sources and can...
11/28/2019

Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation

The performance of acquisition functions for Bayesian optimisation is in...
02/12/2019

Multi-objective Bayesian optimisation with preferences over objectives

We present a Bayesian multi-objective optimisation algorithm that allows...
04/17/2020

What do you Mean? The Role of the Mean Function in Bayesian Optimisation

Bayesian optimisation is a popular approach for optimising expensive bla...
10/17/2019

Achieving Robustness to Aleatoric Uncertainty with Heteroscedastic Bayesian Optimisation

Bayesian optimisation is an important decision-making tool for high-stak...
12/15/2020

Are we Forgetting about Compositional Optimisers in Bayesian Optimisation?

Bayesian optimisation presents a sample-efficient methodology for global...