Expectation-Propagation for Likelihood-Free Inference

07/29/2011
by   Simon Barthelmé, et al.
0

Many models of interest in the natural and social sciences have no closed-form likelihood function, which means that they cannot be treated using the usual techniques of statistical inference. In the case where such models can be efficiently simulated, Bayesian inference is still possible thanks to the Approximate Bayesian Computation (ABC) algorithm. Although many refinements have been suggested, ABC inference is still far from routine. ABC is often excruciatingly slow due to very low acceptance rates. In addition, ABC requires introducing a vector of "summary statistics", the choice of which is relatively arbitrary, and often require some trial and error, making the whole process quite laborious for the user. We introduce in this work the EP-ABC algorithm, which is an adaptation to the likelihood-free context of the variational approximation algorithm known as Expectation Propagation (Minka, 2001). The main advantage of EP-ABC is that it is faster by a few orders of magnitude than standard algorithms, while producing an overall approximation error which is typically negligible. A second advantage of EP-ABC is that it replaces the usual global ABC constraint on the vector of summary statistics computed on the whole dataset, by n local constraints of the form that apply separately to each data-point. As a consequence, it is often possible to do away with summary statistics entirely. In that case, EP-ABC approximates directly the evidence (marginal likelihood) of the model. Comparisons are performed in three real-world applications which are typical of likelihood-free inference, including one application in neuroscience which is novel, and possibly too challenging for standard ABC techniques.

READ FULL TEXT
research
09/11/2019

Efficient Bayesian synthetic likelihood with whitening transformations

Likelihood-free methods are an established approach for performing appro...
research
05/24/2023

Wasserstein Gaussianization and Efficient Variational Bayes for Robust Bayesian Synthetic Likelihood

The Bayesian Synthetic Likelihood (BSL) method is a widely-used tool for...
research
05/22/2018

Fast and Accurate Binary Response Mixed Model Analysis via Expectation Propagation

Expectation propagation is a general prescription for approximation of i...
research
10/03/2018

An easy-to-use empirical likelihood ABC method

Many scientifically well-motivated statistical models in natural, engine...
research
07/03/2020

Transformations in Semi-Parametric Bayesian Synthetic Likelihood

Bayesian synthetic likelihood (BSL) is a popular method for performing a...
research
10/12/2022

The Fixed Landscape Inference MethOd (flimo): an alternative to Approximate Bayesian Computation, faster by several orders of magnitude

Modelling in biology must adapt to increasingly complex and massive data...
research
12/16/2010

Fast Convergent Algorithms for Expectation Propagation Approximate Bayesian Inference

We propose a novel algorithm to solve the expectation propagation relaxa...

Please sign up or login with your details

Forgot password? Click here to reset