Component-wise approximate Bayesian computation via Gibbs-like steps

05/31/2019
by   Grégoire Clarté, et al.
0

Approximate Bayesian computation methods are useful for generative models with intractable likelihoods. These methods are however sensitive to the dimension of the parameter space, requiring exponentially increasing resources as this dimension grows. To tackle this difficulty, we explore a Gibbs version of the ABC approach that runs component-wise approximate Bayesian computation steps aimed at the corresponding conditional posterior distributions, and based on summary statistics of reduced dimensions. While lacking the standard justifications for the Gibbs sampler, the resulting Markov chain is shown to converge in distribution under some partial independence conditions. The associated stationary distribution can further be shown to be close to the true posterior distribution and some hierarchical versions of the proposed mechanism enjoy a closed form limiting distribution. Experiments also demonstrate the gain in efficiency brought by the Gibbs version over the standard solution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2022

Approximate Gibbs sampler for Bayesian Huberized lasso

The Bayesian lasso is well-known as a Bayesian alternative for lasso. Al...
research
01/24/2019

Gibbs posterior convergence and the thermodynamic formalism

In this paper we consider a Bayesian framework for making inferences abo...
research
08/26/2019

MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure

Markov chain Monte Carlo (MCMC) samplers are numerical methods for drawi...
research
03/10/2021

Dimension free convergence rates for Gibbs samplers for Bayesian linear mixed models

The emergence of big data has led to a growing interest in so-called con...
research
11/04/2019

Amortized Population Gibbs Samplers with Neural Sufficient Statistics

We develop amortized population Gibbs (APG) samplers, a new class of aut...
research
07/27/2023

Insufficient Gibbs Sampling

In some applied scenarios, the availability of complete data is restrict...
research
07/02/2021

Reconsidering Dependency Networks from an Information Geometry Perspective

Dependency networks (Heckerman et al., 2000) are potential probabilistic...

Please sign up or login with your details

Forgot password? Click here to reset