Practical Bayesian Optimization with Threshold-Guided Marginal Likelihood Maximization

05/18/2019
by   Jungtaek Kim, et al.
0

We propose a practical Bayesian optimization method, of which the surrogate function is Gaussian process regression with threshold-guided marginal likelihood maximization. Because Bayesian optimization consumes much time in finding optimal free parameters of Gaussian process regression, mitigating a time complexity of this step is critical to speed up Bayesian optimization. For this reason, we propose a simple, but straightforward Bayesian optimization method, assuming a reasonable condition, which is observed in many practical examples. Our experimental results confirm that our method is effective to reduce the execution time. All implementations are available in our repository.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2015

Local Nonstationarity for Efficient Bayesian Optimization

Bayesian optimization has shown to be a fundamental global optimization ...
research
04/21/2020

Bayesian Optimization of Hyperparameters when the Marginal Likelihood is Estimated by MCMC

Bayesian models often involve a small set of hyperparameters determined ...
research
04/11/2023

Bayesian Optimization of Catalysts With In-context Learning

Large language models (LLMs) are able to do accurate classification with...
research
01/17/2016

On-line Bayesian System Identification

We consider an on-line system identification setting, in which new data ...
research
07/21/2018

Generic Camera Attribute Control using Bayesian Optimization

Cameras are the most widely exploited sensor in both robotics and comput...
research
12/12/2017

Practical Bayesian optimization in the presence of outliers

Inference in the presence of outliers is an important field of research ...
research
03/25/2021

Sample-efficient Plasma Spray Process Configuration with Constrained Bayesian Optimization

Recent work has shown constrained Bayesian optimization to be a powerful...

Please sign up or login with your details

Forgot password? Click here to reset