Improving the Accuracy of Marginal Approximations in Likelihood-Free Inference via Localisation

07/14/2022
by   Christopher Drovandi, et al.
0

Likelihood-free methods are an essential tool for performing inference for implicit models which can be simulated from, but for which the corresponding likelihood is intractable. However, common likelihood-free methods do not scale well to a large number of model parameters. A promising approach to high-dimensional likelihood-free inference involves estimating low-dimensional marginal posteriors by conditioning only on summary statistics believed to be informative for the low-dimensional component, and then combining the low-dimensional approximations in some way. In this paper, we demonstrate that such low-dimensional approximations can be surprisingly poor in practice for seemingly intuitive summary statistic choices. We describe an idealized low-dimensional summary statistic that is, in principle, suitable for marginal estimation. However, a direct approximation of the idealized choice is difficult in practice. We thus suggest an alternative approach to marginal estimation which is easier to implement and automate. Given an initial choice of low-dimensional summary statistic that might only be informative about a marginal posterior location, the new method improves performance by first crudely localising the posterior approximation using all the summary statistics to ensure global identifiability, followed by a second step that hones in on an accurate low-dimensional approximation using the low-dimensional summary statistic. We show that the posterior this approach targets can be represented as a logarithmic pool of posterior distributions based on the low-dimensional and full summary statistics, respectively. The good performance of our method is illustrated in several examples.

READ FULL TEXT
research
10/15/2020

Detecting conflicting summary statistics in likelihood-free inference

Bayesian likelihood-free methods implement Bayesian inference using simu...
research
03/03/2021

A Comparison of Likelihood-Free Methods With and Without Summary Statistics

Likelihood-free methods are useful for parameter estimation of complex m...
research
06/06/2022

Minimizing the Expected Posterior Entropy Yields Optimal Summary Statistics

Extracting low-dimensional summary statistics from large datasets is ess...
research
01/25/2019

Local dimension reduction of summary statistics for likelihood-free inference

Approximate Bayesian computation (ABC) and other likelihood-free inferen...
research
05/15/2023

Refining Amortized Posterior Approximations using Gradient-Based Summary Statistics

We present an iterative framework to improve the amortized approximation...
research
03/26/2015

Likelihood-free Model Choice

This document is an invited chapter covering the specificities of ABC mo...
research
07/02/2021

Truncated Marginal Neural Ratio Estimation

Parametric stochastic simulators are ubiquitous in science, often featur...

Please sign up or login with your details

Forgot password? Click here to reset