Parallel Gaussian process surrogate method to accelerate likelihood-free inference

05/03/2019
by   Marko Järvenpää, et al.
0

We consider Bayesian inference when only a limited number of noisy log-likelihood evaluations can be obtained. This occurs for example when complex simulator-based statistical models are fitted to data, and synthetic likelihood (SL) is used to form the noisy log-likelihood estimates using computationally costly forward simulations. We frame the inference task as a Bayesian sequential design problem, where the log-likelihood function is modelled with a hierarchical Gaussian process (GP) surrogate model, which is used to efficiently select additional log-likelihood evaluation locations. Motivated by recent progress in batch Bayesian optimisation, we develop various batch-sequential strategies where multiple simulations are adaptively selected to minimise either the expected or median loss function measuring the uncertainty in the resulting posterior. We analyse the properties of the resulting method theoretically and empirically. Experiments with toy problems and three simulation models suggest that our method is robust, highly parallelisable, and sample-efficient.

READ FULL TEXT
research
04/08/2021

Approximate Bayesian inference from noisy likelihoods with Gaussian process emulated MCMC

We present an efficient approach for doing approximate Bayesian inferenc...
research
10/14/2019

Batch simulations and uncertainty quantification in Gaussian process surrogate approximate Bayesian computation

Surrogate models such as Gaussian processes (GP) have been proposed to a...
research
10/14/2019

Batch simulations and uncertainty quantification in Gaussian process surrogate-based approximate Bayesian computation

Surrogate models such as Gaussian processes (GP) have been proposed to a...
research
11/21/2022

Active Discrimination Learning for Gaussian Process Models

The paper covers the design and analysis of experiments to discriminate ...
research
04/03/2017

Efficient acquisition rules for model-based approximate Bayesian computation

Approximate Bayesian computation (ABC) is a method for Bayesian inferenc...
research
01/07/2014

Accelerating ABC methods using Gaussian processes

Approximate Bayesian computation (ABC) methods are used to approximate p...
research
02/25/2022

Scalable Gaussian-process regression and variable selection using Vecchia approximations

Gaussian process (GP) regression is a flexible, nonparametric approach t...

Please sign up or login with your details

Forgot password? Click here to reset