Stratified Bayesian Optimization

02/07/2016
by   Saul Toscano-Palmerin, et al.
0

We consider derivative-free black-box global optimization of expensive noisy functions, when most of the randomness in the objective is produced by a few influential scalar random inputs. We present a new Bayesian global optimization algorithm, called Stratified Bayesian Optimization (SBO), which uses this strong dependence to improve performance. Our algorithm is similar in spirit to stratification, a technique from simulation, which uses strong dependence on a categorical representation of the random input to reduce variance. We demonstrate in numerical experiments that SBO outperforms state-of-the-art Bayesian optimization benchmarks that do not leverage this dependence.

READ FULL TEXT

page 6

page 11

research
11/26/2020

Combinatorial Bayesian Optimization with Random Mapping Functions to Convex Polytope

Bayesian optimization is a popular method for solving the problem of glo...
research
03/13/2017

Bayesian Optimization with Gradients

Bayesian optimization has been successful at global optimization of expe...
research
05/11/2020

Upper Trust Bound Feasibility Criterion for Mixed Constrained Bayesian Optimization with Application to Aircraft Design

Bayesian optimization methods have been successfully applied to black bo...
research
05/11/2017

Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search

Computational models in fields such as computational neuroscience are of...
research
01/18/2021

TREGO: a Trust-Region Framework for Efficient Global Optimization

Efficient Global Optimization (EGO) is the canonical form of Bayesian op...
research
10/07/2022

Neighbor Regularized Bayesian Optimization for Hyperparameter Optimization

Bayesian Optimization (BO) is a common solution to search optimal hyperp...
research
05/29/2019

Lifelong Bayesian Optimization

Automatic Machine Learning (Auto-ML) systems tackle the problem of autom...

Please sign up or login with your details

Forgot password? Click here to reset