Likelihood-Free Inference with Deep Gaussian Processes

06/18/2020
by   Alexander Aushev, et al.
14

In recent years, surrogate models have been successfully used in likelihood-free inference to decrease the number of simulator evaluations. The current state-of-the-art performance for this task has been achieved by Bayesian Optimization with Gaussian Processes (GPs). While this combination works well for unimodal target distributions, it is restricting the flexibility and applicability of Bayesian Optimization for accelerating likelihood-free inference more generally. We address this problem by proposing a Deep Gaussian Process (DGP) surrogate model that can handle more irregularly behaved target distributions. Our experiments show how DGPs can outperform GPs on objective functions with multimodal distributions and maintain a comparable performance in unimodal cases. This confirms that DGPs as surrogate models can extend the applicability of Bayesian Optimization for likelihood-free inference (BOLFI), while adding computational overhead that remains negligible for computationally intensive simulators.

READ FULL TEXT

page 2

page 13

research
03/02/2022

Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processes

Bayesian optimization is a technique for optimizing black-box target fun...
research
11/02/2022

Fantasizing with Dual GPs in Bayesian Optimization and Active Learning

Gaussian processes (GPs) are the main surrogate functions used for seque...
research
02/19/2015

Scalable Bayesian Optimization Using Deep Neural Networks

Bayesian optimization is an effective methodology for the global optimiz...
research
02/21/2020

Knot Selection in Sparse Gaussian Processes

Knot-based, sparse Gaussian processes have enjoyed considerable success ...
research
01/30/2023

A Fully-Automated Framework Integrating Gaussian Process Regression and Bayesian Optimization to Design Pin-Fins

Pin fins are imperative in the cooling of turbine blades. The designs of...
research
05/31/2019

Deep Bayesian Optimization on Attributed Graphs

Attributed graphs, which contain rich contextual features beyond just ne...
research
12/09/2017

Variational Inference over Non-differentiable Cardiac Simulators using Bayesian Optimization

Performing inference over simulators is generally intractable as their r...

Please sign up or login with your details

Forgot password? Click here to reset