DeepAI
Log In Sign Up

Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems

04/23/2021
by   Samuel Kim, et al.
0

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely black-box. The data may have some known structure, e.g. symmetries, and the data generation process can yield useful intermediate or auxiliary information in addition to the value of the optimization objective. However, surrogate models traditionally employed in BO, such as Gaussian Processes (GPs), scale poorly with dataset size and struggle to incorporate known structure or auxiliary information. Instead, we propose performing BO on complex, structured problems by using Bayesian Neural Networks (BNNs), a class of scalable surrogate models that have the representation power and flexibility to handle structured data and exploit auxiliary information. We demonstrate BO on a number of realistic problems in physics and chemistry, including topology optimization of photonic crystal materials using convolutional neural networks, and chemical property optimization of molecules using graph neural networks. On these complex tasks, we show that BNNs often outperform GPs as surrogate models for BO in terms of both sampling efficiency and computational cost.

READ FULL TEXT

page 6

page 16

03/02/2022

Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processes

Bayesian optimization is a technique for optimizing black-box target fun...
02/19/2015

Scalable Bayesian Optimization Using Deep Neural Networks

Bayesian optimization is an effective methodology for the global optimiz...
05/31/2019

Deep Bayesian Optimization on Attributed Graphs

Attributed graphs, which contain rich contextual features beyond just ne...
09/17/2019

Efficient Transfer Bayesian Optimization with Auxiliary Information

We propose an efficient transfer Bayesian optimization method, which fin...
01/31/2019

ProBO: a Framework for Using Probabilistic Programming in Bayesian Optimization

Optimizing an expensive-to-query function is a common task in science an...
11/10/2021

Searching in the Forest for Local Bayesian Optimization

Because of its sample efficiency, Bayesian optimization (BO) has become ...
01/14/2023

On the role of Model Uncertainties in Bayesian Optimization

Bayesian optimization (BO) is a popular method for black-box optimizatio...