Efficient Bayesian synthetic likelihood with whitening transformations

09/11/2019
by   Jacob W. Priddle, et al.
9

Likelihood-free methods are an established approach for performing approximate Bayesian inference for models with intractable likelihood functions. However, they can be computationally demanding. Bayesian synthetic likelihood (BSL) is a popular such method that approximates the likelihood function of the summary statistic with a known, tractable distribution – typically Gaussian – and then performs statistical inference using standard likelihood-based techniques. However, as the number of summary statistics grows, the number of model simulations required to accurately estimate the covariance matrix for this likelihood rapidly increases. This poses significant challenge for the application of BSL, especially in cases where model simulation is expensive. In this article we propose whitening BSL (wBSL) – an efficient BSL method that uses approximate whitening transformations to decorrelate the summary statistics at each algorithm iteration. We show empirically that this can reduce the number of model simulations required to implement BSL by more than an order of magnitude, without much loss of accuracy. We explore a range of whitening procedures and demonstrate the performance of wBSL on a range of simulated and real modelling scenarios from ecology and biology.

READ FULL TEXT

page 10

page 12

page 14

page 15

page 19

page 24

page 25

page 31

research
07/03/2020

Transformations in Semi-Parametric Bayesian Synthetic Likelihood

Bayesian synthetic likelihood (BSL) is a popular method for performing a...
research
09/21/2018

Parameter inference and model comparison using theoretical predictions from noisy simulations

When inferring unknown parameters or comparing different models, data mu...
research
07/29/2011

Expectation-Propagation for Likelihood-Free Inference

Many models of interest in the natural and social sciences have no close...
research
02/13/2019

Bayesian inference using synthetic likelihood: asymptotics and adjustments

Implementing Bayesian inference is often computationally challenging in ...
research
09/14/2019

Rapid Bayesian inference for expensive stochastic models

Almost all fields of science rely upon statistical inference to estimate...
research
10/03/2018

An easy-to-use empirical likelihood ABC method

Many scientifically well-motivated statistical models in natural, engine...
research
10/28/2019

Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset

This paper tackles the challenge presented by small-data to the task of ...

Please sign up or login with your details

Forgot password? Click here to reset