Log In Sign Up

Scalable and Flexible Deep Bayesian Optimization with Auxiliary Information for Scientific Problems

by   Samuel Kim, et al.

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely black-box. The data may have some known structure, e.g. symmetries, and the data generation process can yield useful intermediate or auxiliary information in addition to the value of the optimization objective. However, surrogate models traditionally employed in BO, such as Gaussian Processes (GPs), scale poorly with dataset size and struggle to incorporate known structure or auxiliary information. Instead, we propose performing BO on complex, structured problems by using Bayesian Neural Networks (BNNs), a class of scalable surrogate models that have the representation power and flexibility to handle structured data and exploit auxiliary information. We demonstrate BO on a number of realistic problems in physics and chemistry, including topology optimization of photonic crystal materials using convolutional neural networks, and chemical property optimization of molecules using graph neural networks. On these complex tasks, we show that BNNs often outperform GPs as surrogate models for BO in terms of both sampling efficiency and computational cost.


page 6

page 16


Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processes

Bayesian optimization is a technique for optimizing black-box target fun...

Scalable Bayesian Optimization Using Deep Neural Networks

Bayesian optimization is an effective methodology for the global optimiz...

Deep Bayesian Optimization on Attributed Graphs

Attributed graphs, which contain rich contextual features beyond just ne...

Efficient Transfer Bayesian Optimization with Auxiliary Information

We propose an efficient transfer Bayesian optimization method, which fin...

ProBO: a Framework for Using Probabilistic Programming in Bayesian Optimization

Optimizing an expensive-to-query function is a common task in science an...

Searching in the Forest for Local Bayesian Optimization

Because of its sample efficiency, Bayesian optimization (BO) has become ...

On the role of Model Uncertainties in Bayesian Optimization

Bayesian optimization (BO) is a popular method for black-box optimizatio...