Predictive Entropy Search for Multi-objective Bayesian Optimization

11/17/2015
by   Daniel Hernández-Lobato, et al.
0

We present PESMO, a Bayesian method for identifying the Pareto set of multi-objective optimization problems, when the functions are expensive to evaluate. The central idea of PESMO is to choose evaluation points so as to maximally reduce the entropy of the posterior distribution over the Pareto set. Critically, the PESMO multi-objective acquisition function can be decomposed as a sum of objective-specific acquisition functions, which enables the algorithm to be used in decoupled scenarios in which the objectives can be evaluated separately and perhaps with different costs. This decoupling capability also makes it possible to identify difficult objectives that require more evaluations. PESMO also offers gains in efficiency, as its cost scales linearly with the number of objectives, in comparison to the exponential cost of other methods. We compare PESMO with other related methods for multi-objective Bayesian optimization on synthetic and real-world problems. The results show that PESMO produces better recommendations with a smaller number of evaluations of the objectives, and that a decoupled evaluation can lead to improvements in performance, particularly when the number of objectives is large.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/02/2023

Bayesian Optimization of Multiple Objectives with Different Latencies

Multi-objective Bayesian optimization aims to find the Pareto front of o...
research
06/01/2019

Multi-objective Bayesian Optimization using Pareto-frontier Entropy

We propose Pareto-frontier entropy search (PFES) for multi-objective Bay...
research
06/01/2023

BOtied: Multi-objective Bayesian optimization with tied multivariate ranks

Many scientific and industrial applications require joint optimization o...
research
05/30/2018

A Flexible Multi-Objective Bayesian Optimization Approach using Random Scalarizations

Many real world applications can be framed as multi-objective optimizati...
research
12/27/2021

Expected hypervolume improvement for simultaneous multi-objective and multi-fidelity optimization

Bayesian optimization has proven to be an efficient method to optimize e...
research
08/25/2022

Alleviating Search Bias in Bayesian Evolutionary Optimization with Many Heterogeneous Objectives

Multi-objective optimization problems whose objectives have different ev...
research
10/05/2022

Multi-objective optimization via equivariant deep hypervolume approximation

Optimizing multiple competing objectives is a common problem across scie...

Please sign up or login with your details

Forgot password? Click here to reset