High Dimensional Bayesian Optimization Using Dropout

02/15/2018
by   Cheng Li, et al.
0

Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or the additive form of the objective function. We propose a new method for high-dimensional Bayesian optimization, that uses a dropout strategy to optimize only a subset of variables at each iteration. We derive theoretical bounds for the regret and show how it can inform the derivation of our algorithm. We demonstrate the efficacy of our algorithms for optimization on two benchmark functions and two real-world applications- training cascade classifiers and optimizing alloy composition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/21/2019

High Dimensional Bayesian Optimization via Supervised Dimension Reduction

Bayesian optimization (BO) has been broadly applied to computational exp...
research
05/31/2023

Relaxing the Additivity Constraints in Decentralized No-Regret High-Dimensional Bayesian Optimization

Bayesian Optimization (BO) is typically used to optimize an unknown func...
research
12/24/2020

High-Dimensional Bayesian Optimization via Tree-Structured Additive Models

Bayesian Optimization (BO) has shown significant success in tackling exp...
research
02/20/2018

High-Dimensional Bayesian Optimization via Additive Models with Overlapping Groups

Bayesian optimization (BO) is a popular technique for sequential black-b...
research
07/30/2021

A New Bayesian Optimization Algorithm for Complex High-Dimensional Disease Epidemic Systems

This paper presents an Improved Bayesian Optimization (IBO) algorithm to...
research
02/16/2023

Enhancing High-dimensional Bayesian Optimization by Optimizing the Acquisition Function Maximizer Initialization

Bayesian optimization (BO) is widely used to optimize black-box function...
research
11/19/2017

Decentralized High-Dimensional Bayesian Optimization with Factor Graphs

This paper presents a novel decentralized high-dimensional Bayesian opti...

Please sign up or login with your details

Forgot password? Click here to reset