DeepAI AI Chat
Log In Sign Up

Scalable Global Optimization via Local Bayesian Optimization

by   David Eriksson, et al.
University of Warwick

Bayesian optimization has recently emerged as a popular method for the sample-efficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains challenging, and on difficult problems Bayesian optimization is often not competitive with other paradigms. In this paper we take the view that this is due to the implicit homogeneity of the global probabilistic models and an overemphasized exploration that results from global acquisition. This motivates the design of a local probabilistic approach for global optimization of large-scale high-dimensional problems. We propose the TuRBO algorithm that fits a collection of local models and performs a principled global allocation of samples across these models via an implicit bandit approach. A comprehensive evaluation demonstrates that TuRBO outperforms state-of-the-art methods from machine learning and operations research on problems spanning reinforcement learning, robotics, and the natural sciences.


Scalable Constrained Bayesian Optimization

The global optimization of a high-dimensional black-box function under b...

Advancing Bayesian Optimization: The Mixed-Global-Local (MGL) Kernel and Length-Scale Cool Down

Bayesian Optimization (BO) has become a core method for solving expensiv...

Robust Bayesian optimization with reinforcement learned acquisition functions

In Bayesian optimization (BO) for expensive black-box optimization tasks...

Searching in the Forest for Local Bayesian Optimization

Because of its sample efficiency, Bayesian optimization (BO) has become ...

Bayesian Optimization of Text Representations

When applying machine learning to problems in NLP, there are many choice...

Scalable Bayesian optimization with high-dimensional outputs using randomized prior networks

Several fundamental problems in science and engineering consist of globa...

Designing Biological Sequences via Meta-Reinforcement Learning and Bayesian Optimization

The ability to accelerate the design of biological sequences can have a ...