DeepAI AI Chat
Log In Sign Up

High Dimensional Bayesian Optimization Using Dropout

by   Cheng Li, et al.

Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or the additive form of the objective function. We propose a new method for high-dimensional Bayesian optimization, that uses a dropout strategy to optimize only a subset of variables at each iteration. We derive theoretical bounds for the regret and show how it can inform the derivation of our algorithm. We demonstrate the efficacy of our algorithms for optimization on two benchmark functions and two real-world applications- training cascade classifiers and optimizing alloy composition.


page 1

page 2

page 3

page 4


High Dimensional Bayesian Optimization via Supervised Dimension Reduction

Bayesian optimization (BO) has been broadly applied to computational exp...

Projective Preferential Bayesian Optimization

Bayesian optimization is an effective method for finding extrema of a bl...

Decentralized High-Dimensional Bayesian Optimization with Factor Graphs

This paper presents a novel decentralized high-dimensional Bayesian opti...

High-Dimensional Bayesian Optimization via Additive Models with Overlapping Groups

Bayesian optimization (BO) is a popular technique for sequential black-b...

A New Bayesian Optimization Algorithm for Complex High-Dimensional Disease Epidemic Systems

This paper presents an Improved Bayesian Optimization (IBO) algorithm to...

Enhancing High-dimensional Bayesian Optimization by Optimizing the Acquisition Function Maximizer Initialization

Bayesian optimization (BO) is widely used to optimize black-box function...

High Dimensional Bayesian Optimisation and Bandits via Additive Models

Bayesian Optimisation (BO) is a technique used in optimising a D-dimensi...