On a Variational Approximation based Empirical Likelihood ABC Method

11/12/2020
by   Sanjay Chaudhuri, et al.
0

Many scientifically well-motivated statistical models in natural, engineering, and environmental sciences are specified through a generative process. However, in some cases, it may not be possible to write down the likelihood for these models analytically. Approximate Bayesian computation (ABC) methods allow Bayesian inference in such situations. The procedures are nonetheless typically computationally intensive. Recently, computationally attractive empirical likelihood-based ABC methods have been suggested in the literature. All of these methods rely on the availability of several suitable analytically tractable estimating equations, and this is sometimes problematic. We propose an easy-to-use empirical likelihood ABC method in this article. First, by using a variational approximation argument as a motivation, we show that the target log-posterior can be approximated as a sum of an expected joint log-likelihood and the differential entropy of the data generating density. The expected log-likelihood is then estimated by an empirical likelihood where the only inputs required are a choice of summary statistic, it's observed value, and the ability to simulate the chosen summary statistics for any parameter value under the model. The differential entropy is estimated from the simulated summaries using traditional methods. Posterior consistency is established for the method, and we discuss the bounds for the required number of simulated summaries in detail. The performance of the proposed method is explored in various examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2018

An easy-to-use empirical likelihood ABC method

Many scientifically well-motivated statistical models in natural, engine...
research
04/09/2019

Robust Approximate Bayesian Inference with Synthetic Likelihood

Bayesian synthetic likelihood (BSL) is now a well-established method for...
research
02/13/2019

Bayesian inference using synthetic likelihood: asymptotics and adjustments

Implementing Bayesian inference is often computationally challenging in ...
research
11/09/2020

Scalable Approximate Bayesian Computation for Growing Network Models via Extrapolated and Sampled Summaries

Approximate Bayesian computation (ABC) is a simulation-based likelihood-...
research
12/01/2022

Are you using test log-likelihood correctly?

Test log-likelihood is commonly used to compare different models of the ...
research
10/03/2019

Empirical Likelihood Under Mis-specification: Degeneracies and Random Critical Points

We investigate empirical likelihood obtained from mis-specified (i.e. bi...
research
01/25/2019

Local dimension reduction of summary statistics for likelihood-free inference

Approximate Bayesian computation (ABC) and other likelihood-free inferen...

Please sign up or login with your details

Forgot password? Click here to reset