Efficient Bayesian synthetic likelihood with whitening transformations

09/11/2019
by   Jacob W. Priddle, et al.
9

Likelihood-free methods are an established approach for performing approximate Bayesian inference for models with intractable likelihood functions. However, they can be computationally demanding. Bayesian synthetic likelihood (BSL) is a popular such method that approximates the likelihood function of the summary statistic with a known, tractable distribution – typically Gaussian – and then performs statistical inference using standard likelihood-based techniques. However, as the number of summary statistics grows, the number of model simulations required to accurately estimate the covariance matrix for this likelihood rapidly increases. This poses significant challenge for the application of BSL, especially in cases where model simulation is expensive. In this article we propose whitening BSL (wBSL) – an efficient BSL method that uses approximate whitening transformations to decorrelate the summary statistics at each algorithm iteration. We show empirically that this can reduce the number of model simulations required to implement BSL by more than an order of magnitude, without much loss of accuracy. We explore a range of whitening procedures and demonstrate the performance of wBSL on a range of simulated and real modelling scenarios from ecology and biology.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 10

page 12

page 14

page 15

page 19

page 24

page 25

page 31

07/03/2020

Transformations in Semi-Parametric Bayesian Synthetic Likelihood

Bayesian synthetic likelihood (BSL) is a popular method for performing a...
04/09/2019

Robust Approximate Bayesian Inference with Synthetic Likelihood

Bayesian synthetic likelihood (BSL) is now a well-established method for...
09/21/2018

Parameter inference and model comparison using theoretical predictions from noisy simulations

When inferring unknown parameters or comparing different models, data mu...
07/29/2011

Expectation-Propagation for Likelihood-Free Inference

Many models of interest in the natural and social sciences have no close...
02/13/2019

Bayesian inference using synthetic likelihood: asymptotics and adjustments

Implementing Bayesian inference is often computationally challenging in ...
09/14/2019

Rapid Bayesian inference for expensive stochastic models

Almost all fields of science rely upon statistical inference to estimate...
03/03/2021

A Comparison of Likelihood-Free Methods With and Without Summary Statistics

Likelihood-free methods are useful for parameter estimation of complex m...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.