Practical Batch Bayesian Optimization for Less Expensive Functions

11/05/2018
by   Vu Nguyen, et al.
0

Bayesian optimization (BO) and its batch extensions are successful for optimizing expensive black-box functions. However, these traditional BO approaches are not yet ideal for optimizing less expensive functions when the computational cost of BO can dominate the cost of evaluating the blackbox function. Examples of these less expensive functions are cheap machine learning models, inexpensive physical experiment through simulators, and acquisition function optimization in Bayesian optimization. In this paper, we consider a batch BO setting for situations where function evaluations are less expensive. Our model is based on a new exploration strategy using geometric distance that provides an alternative way for exploration, selecting a point far from the observed locations. Using that intuition, we propose to use Sobol sequence to guide exploration that will get rid of running multiple global optimization steps as used in previous works. Based on the proposed distance exploration, we present an efficient batch BO approach. We demonstrate that our approach outperforms other baselines and global optimization methods when the function evaluations are less expensive.

READ FULL TEXT

page 4

page 5

research
01/20/2021

A New Knowledge Gradient-based Method for Constrained Bayesian Optimization

Black-box problems are common in real life like structural design, drug ...
research
05/29/2015

Batch Bayesian Optimization via Local Penalization

The popularity of Bayesian optimization methods for efficient exploratio...
research
02/26/2021

Batch Bayesian Optimization on Permutations using Acquisition Weighted Kernels

In this work we propose a batch Bayesian optimization method for combina...
research
02/24/2020

Efficient Rollout Strategies for Bayesian Optimization

Bayesian optimization (BO) is a class of sample-efficient global optimiz...
research
06/18/2021

Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks

Bayesian optimization (BO) is a powerful approach for optimizing black-b...
research
10/18/2021

Efficient Exploration in Binary and Preferential Bayesian Optimization

Bayesian optimization (BO) is an effective approach to optimize expensiv...
research
01/31/2022

SnAKe: Bayesian Optimization with Pathwise Exploration

Bayesian Optimization is a very effective tool for optimizing expensive ...

Please sign up or login with your details

Forgot password? Click here to reset