Bayesian Optimization of Multiple Objectives with Different Latencies

02/02/2023
by   Jack M. Buckingham, et al.
0

Multi-objective Bayesian optimization aims to find the Pareto front of optimal trade-offs between a set of expensive objectives while collecting as few samples as possible. In some cases, it is possible to evaluate the objectives separately, and a different latency or evaluation cost can be associated with each objective. This presents an opportunity to learn the Pareto front faster by evaluating the cheaper objectives more frequently. We propose a scalarization based knowledge gradient acquisition function which accounts for the different evaluation costs of the objectives. We prove consistency of the algorithm and show empirically that it significantly outperforms a benchmark algorithm which always evaluates both objectives.

READ FULL TEXT

page 6

page 23

research
11/17/2015

Predictive Entropy Search for Multi-objective Bayesian Optimization

We present PESMO, a Bayesian method for identifying the Pareto set of mu...
research
05/17/2021

Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement

Optimizing multiple competing black-box objectives is a challenging prob...
research
01/18/2020

FlexiBO: Cost-Aware Multi-Objective Optimization of Deep Neural Networks

One of the key challenges in designing machine learning systems is to de...
research
02/18/2019

The Kalai-Smorodinski solution for many-objective Bayesian optimization

An ongoing aim of research in multiobjective Bayesian optimization is to...
research
10/13/2022

Computer-Aided Multi-Objective Optimization in Small Molecule Discovery

Molecular discovery is a multi-objective optimization problem that requi...
research
06/22/2021

Latency-Aware Neural Architecture Search with Multi-Objective Bayesian Optimization

When tuning the architecture and hyperparameters of large machine learni...
research
02/23/2020

ConBO: Conditional Bayesian Optimization

Bayesian optimization is a class of data efficient model based algorithm...

Please sign up or login with your details

Forgot password? Click here to reset