HEBO: Heteroscedastic Evolutionary Bayesian Optimisation

12/07/2020
by   Alexander I. Cowen-Rivers, et al.
17

We introduce HEBO: Heteroscedastic Evolutionary Bayesian Optimisation that won the NeurIPS 2020 black-box optimisation competition. We present non-conventional modifications to the surrogate model and acquisition maximisation process and show such a combination superior against all baselines provided by the Bayesmark package. Lastly, we perform an ablation study to highlight the components that contributed to the success of HEBO.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 11

10/15/2020

Asynchronous ε-Greedy Bayesian Optimisation

Bayesian Optimisation (BO) is a popular surrogate model-based approach f...
12/15/2020

Are we Forgetting about Compositional Optimisers in Bayesian Optimisation?

Bayesian optimisation presents a sample-efficient methodology for global...
05/27/2021

Bayesian Optimisation for Constrained Problems

Many real-world optimisation problems such as hyperparameter tuning in m...
02/05/2020

ε-shotgun: ε-greedy Batch Bayesian Optimisation

Bayesian optimisation is a popular, surrogate model-based approach for o...
06/10/2021

Bayesian Optimisation with Formal Guarantees

Application domains of Bayesian optimization include optimizing black-bo...
04/15/2020

Automatic Generation of Algorithms for Black-Box Robust Optimisation Problems

We develop algorithms capable of tackling robust black-box optimisation ...
06/07/2021

High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learning

We introduce a method based on deep metric learning to perform Bayesian ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.