Monte Carlo Tree Search based Variable Selection for High Dimensional Bayesian Optimization

10/04/2022
by   Lei Song, et al.
0

Bayesian optimization (BO) is a class of popular methods for expensive black-box optimization, and has been widely applied to many scenarios. However, BO suffers from the curse of dimensionality, and scaling it to high-dimensional problems is still a challenge. In this paper, we propose a variable selection method MCTS-VS based on Monte Carlo tree search (MCTS), to iteratively select and optimize a subset of variables. That is, MCTS-VS constructs a low-dimensional subspace via MCTS and optimizes in the subspace with any BO algorithm. We give a theoretical analysis of the general variable selection method to reveal how it can work. Experiments on high-dimensional synthetic functions and real-world problems (i.e., NAS-bench problems and MuJoCo locomotion tasks) show that MCTS-VS equipped with a proper BO optimizer can achieve state-of-the-art performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/20/2021

Computationally Efficient High-Dimensional Bayesian Optimization via Variable Selection

Bayesian Optimization (BO) is a method for globally optimizing black-box...
research
05/01/2018

Scalable Importance Tempering and Bayesian Variable Selection

We propose a Monte Carlo algorithm to sample from high-dimensional proba...
research
02/27/2021

High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspaces

Bayesian optimization (BO) is a powerful paradigm for efficient optimiza...
research
06/01/2019

Automated Machine Learning with Monte-Carlo Tree Search (Extended Version)

The AutoML task consists of selecting the proper algorithm in a machine ...
research
07/20/2020

Variable Selection in Macroeconomic Forecasting with Many Predictors

In the data-rich environment, using many economic predictors to forecast...
research
04/09/2022

Data-analysis software framework 2DMAT and its application to experimental measurements for two-dimensional material structures

An open-source data-analysis framework 2DMAT has been developed for expe...
research
01/25/2020

Bayesian optimization for backpropagation in Monte-Carlo tree search

In large domains, Monte-Carlo tree search (MCTS) is required to estimate...

Please sign up or login with your details

Forgot password? Click here to reset