Parallel Predictive Entropy Search for Batch Global Optimization of Expensive Objective Functions

11/23/2015
by   Amar Shah, et al.
0

We develop parallel predictive entropy search (PPES), a novel algorithm for Bayesian optimization of expensive black-box objective functions. At each iteration, PPES aims to select a batch of points which will maximize the information gain about the global maximizer of the objective. Well known strategies exist for suggesting a single evaluation point based on previous observations, while far fewer are known for selecting batches of points to evaluate in parallel. The few batch selection schemes that have been studied all resort to greedy methods to compute an optimal batch. To the best of our knowledge, PPES is the first non-greedy batch Bayesian optimization strategy. We demonstrate the benefit of this approach in optimization performance on both synthetic and real world applications, including problems in machine learning, rocket science and robotics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/14/2016

The Parallel Knowledge Gradient Method for Batch Bayesian Optimization

In many applications of black-box optimization, one can evaluate multipl...
research
07/30/2021

Trusted-Maximizers Entropy Search for Efficient Bayesian Optimization

Information-based Bayesian optimization (BO) algorithms have achieved st...
research
08/07/2022

A Parallel Technique for Multi-objective Bayesian Global Optimization: Using a Batch Selection of Probability of Improvement

Bayesian global optimization (BGO) is an efficient surrogate-assisted te...
research
03/25/2020

Preferential Batch Bayesian Optimization

Most research in Bayesian optimization (BO) has focused on direct feedba...
research
10/21/2022

Local Bayesian optimization via maximizing probability of descent

Local optimization presents a promising approach to expensive, high-dime...
research
10/21/2020

Batch Sequential Adaptive Designs for Global Optimization

Compared with the fixed-run designs, the sequential adaptive designs (SA...
research
03/03/2022

Sparse Bayesian Optimization

Bayesian optimization (BO) is a powerful approach to sample-efficient op...

Please sign up or login with your details

Forgot password? Click here to reset