A portfolio approach to massively parallel Bayesian optimization

10/18/2021
by   Mickaël Binois, et al.
0

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by building a surrogate model of the black-box that can be used to select the designs to evaluate efficiently via an infill criterion. Still, with higher levels of parallelization becoming available, the strategies that work for a few tens of parallel evaluations become limiting, in particular due to the complexity of selecting more evaluations. It is even more crucial when the black-box is noisy, necessitating more evaluations as well as repeating experiments. Here we propose a scalable strategy that can keep up with massive batching natively, focused on the exploration/exploitation trade-off and a portfolio allocation. We compare the approach with related methods on deterministic and noisy functions, for mono and multiobjective optimization tasks. These experiments show similar or better performance than existing methods, while being orders of magnitude faster.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2020

Parallel Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints

Real-world problems often involve the optimization of several objectives...
research
06/14/2016

The Parallel Knowledge Gradient Method for Batch Bayesian Optimization

In many applications of black-box optimization, one can evaluate multipl...
research
10/03/2022

New Paradigms for Exploiting Parallel Experiments in Bayesian Optimization

Bayesian optimization (BO) is one of the most effective methods for clos...
research
03/10/2023

Multiple Hands Make Light Work: Enhancing Quality and Diversity using MAP-Elites with Multiple Parallel Evolution Strategies

With the development of hardware accelerators and their corresponding to...
research
05/03/2016

Blackbox: A procedure for parallel optimization of expensive black-box functions

This note provides a description of a procedure that is designed to effi...
research
06/07/2023

Self-Adjusting Weighted Expected Improvement for Bayesian Optimization

Bayesian Optimization (BO) is a class of surrogate-based, sample-efficie...
research
08/10/2021

Asymptotic convergence rates for averaging strategies

Parallel black box optimization consists in estimating the optimum of a ...

Please sign up or login with your details

Forgot password? Click here to reset