Harnessing Low-Fidelity Data to Accelerate Bayesian Optimization via Posterior Regularization

02/11/2019
by   Bin Liu, et al.
0

Bayesian optimization (BO) is a powerful derivative-free technique for global optimization of expensive black-box objective functions (BOFs). However, the overhead of BO can still be prohibitive if the number of allowed function evaluations is less than required. In this paper, we investigate how to reduce the required number of function evaluations for BO without compromise in solution quality. We explore the idea of posterior regularization for harnessing low fidelity (LF) data within the Gaussian process upper confidence bound (GP-UCB) framework. The LF data are assumed to arise from previous evaluations of a LF approximation of the BOF. An extra GP expert called LF-GP is trained to fit the LF data. We develop a dynamic weighted product of experts (DW-POE) fusion operator. The regularization is induced from this fusion operator on the posterior of the BOF. The impact of the LF-GP expert on the resulting regularized posterior is adaptively adjusted via Bayesian formulism. Extensive experimental results on benchmark BOF optimization tasks demonstrate the superior performance of the proposed algorithm over state-of-the-arts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/14/2022

On Provably Robust Meta-Bayesian Optimization

Bayesian optimization (BO) has become popular for sequential optimizatio...
research
03/21/2023

Bayesian Optimization for Function Compositions with Applications to Dynamic Pricing

Bayesian Optimization (BO) is used to find the global optima of black bo...
research
06/05/2017

Ensemble Bayesian Optimization

Bayesian Optimization (BO) has been shown to be a very effective paradig...
research
10/22/2021

Gaussian Process Sampling and Optimization with Approximate Upper and Lower Bounds

Many functions have approximately-known upper and/or lower bounds, poten...
research
12/08/2017

Multiple Adaptive Bayesian Linear Regression for Scalable Bayesian Optimization with Warm Start

Bayesian optimization (BO) is a model-based approach for gradient-free b...
research
10/25/2022

Multi-Fidelity Bayesian Optimization with Unreliable Information Sources

Bayesian optimization (BO) is a powerful framework for optimizing black-...
research
07/21/2022

Inference of Regulatory Networks Through Temporally Sparse Data

A major goal in genomics is to properly capture the complex dynamical be...

Please sign up or login with your details

Forgot password? Click here to reset