What Makes an Effective Scalarising Function for Multi-Objective Bayesian Optimisation?

by   Clym Stock-Williams, et al.

Performing multi-objective Bayesian optimisation by scalarising the objectives avoids the computation of expensive multi-dimensional integral-based acquisition functions, instead of allowing one-dimensional standard acquisition functions—such as Expected Improvement—to be applied. Here, two infill criteria based on hypervolume improvement—one recently introduced and one novel—are compared with the multi-surrogate Expected Hypervolume Improvement. The reasons for the disparities in these methods' effectiveness in maximising the hypervolume of the acquired Pareto Front are investigated. In addition, the effect of the surrogate model mean function on exploration and exploitation is examined: careful choice of data normalisation is shown to be preferable to the exploration parameter commonly used with the Expected Improvement acquisition function. Finally, the effectiveness of all the methodological improvements defined here is demonstrated on a real-world problem: the optimisation of a wind turbine blade aerofoil for both aerodynamic performance and structural stiffness. With effective scalarisation, Bayesian optimisation finds a large number of new aerofoil shapes that strongly dominate standard designs.


page 4

page 6

page 8

page 15

page 20

page 21

page 22


R-MBO: A Multi-surrogate Approach for Preference Incorporation in Multi-objective Bayesian Optimisation

Many real-world multi-objective optimisation problems rely on computatio...

Wind Farm Layout Optimisation using Set Based Multi-objective Bayesian Optimisation

Wind energy is one of the cleanest renewable electricity sources and can...

Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation

The performance of acquisition functions for Bayesian optimisation is in...

Multi-objective Bayesian optimisation with preferences over objectives

We present a Bayesian multi-objective optimisation algorithm that allows...

What do you Mean? The Role of the Mean Function in Bayesian Optimisation

Bayesian optimisation is a popular approach for optimising expensive bla...

Achieving Robustness to Aleatoric Uncertainty with Heteroscedastic Bayesian Optimisation

Bayesian optimisation is an important decision-making tool for high-stak...

Are we Forgetting about Compositional Optimisers in Bayesian Optimisation?

Bayesian optimisation presents a sample-efficient methodology for global...