Random postprocessing for combinatorial Bayesian optimization

09/06/2023
by   Keisuke Morita, et al.
0

Model-based sequential approaches to discrete "black-box" optimization, including Bayesian optimization techniques, often access the same points multiple times for a given objective function in interest, resulting in many steps to find the global optimum. Here, we numerically study the effect of a postprocessing method on Bayesian optimization that strictly prohibits duplicated samples in the dataset. We find the postprocessing method significantly reduces the number of sequential steps to find the global optimum, especially when the acquisition function is of maximum a posterior estimation. Our results provide a simple but general strategy to solve the slow convergence of Bayesian optimization for high-dimensional problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/08/2021

Calibration Improves Bayesian Optimization

Bayesian optimization is a procedure that allows obtaining the global op...
research
02/08/2020

Projective Preferential Bayesian Optimization

Bayesian optimization is an effective method for finding extrema of a bl...
research
11/26/2020

Combinatorial Bayesian Optimization with Random Mapping Functions to Convex Polytope

Bayesian optimization is a popular method for solving the problem of glo...
research
07/13/2022

Non-Myopic Multifidelity Bayesian Optimization

Bayesian optimization is a popular framework for the optimization of bla...
research
05/24/2023

Density Ratio Estimation-based Bayesian Optimization with Semi-Supervised Learning

Bayesian optimization has attracted huge attention from diverse research...
research
05/07/2019

Knowing The What But Not The Where in Bayesian Optimization

Bayesian optimization has demonstrated impressive success in finding the...
research
11/20/2019

Bayesian optimization with local search

Global optimization finds applications in a wide range of real world pro...

Please sign up or login with your details

Forgot password? Click here to reset