Automatic Variational ABC

06/28/2016
by   Alexander Moreno, et al.
0

Approximate Bayesian Computation (ABC) is a framework for performing likelihood-free posterior inference for simulation models. Stochastic Variational inference (SVI) is an appealing alternative to the inefficient sampling approaches commonly used in ABC. However, SVI is highly sensitive to the variance of the gradient estimators, and this problem is exacerbated by approximating the likelihood. We draw upon recent advances in variance reduction for SV and likelihood-free inference using deterministic simulations to produce low variance gradient estimators of the variational lower-bound. By then exploiting automatic differentiation libraries we can avoid nearly all model-specific derivations. We demonstrate performance on three problems and compare to existing SVI algorithms. Our results demonstrate the correctness and efficiency of our algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2012

Variational Bayesian Inference with Stochastic Search

Mean-field variational inference is a method for approximate Bayesian po...
research
11/20/2020

Gradient Regularisation as Approximate Variational Inference

Variational inference in Bayesian neural networks is usually performed u...
research
06/19/2019

Provable Gradient Variance Guarantees for Black-Box Variational Inference

Recent variational inference methods use stochastic gradient estimators ...
research
06/05/2023

Variational inference based on a subclass of closed skew normals

Gaussian distributions are widely used in Bayesian variational inference...
research
06/09/2019

Note on the bias and variance of variational inference

In this note, we study the relationship between the variational gap and ...
research
06/27/2023

Likelihood-free neural Bayes estimators for censored inference with peaks-over-threshold models

Inference for spatial extremal dependence models can be computationally ...
research
06/13/2023

Differentiating Metropolis-Hastings to Optimize Intractable Densities

We develop an algorithm for automatic differentiation of Metropolis-Hast...

Please sign up or login with your details

Forgot password? Click here to reset