Marginal sequential Monte Carlo for doubly intractable models

10/12/2017
by   Richard G. Everitt, et al.
0

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte Carlo techniques (Møller et al., 2006; Murray et al., 2006) for tackling this problem; these approaches being members of the more general class of pseudo-marginal, or exact-approximate, Monte Carlo algorithms (Andrieu and Roberts, 2009), which make use of unbiased estimates of intractable posteriors. Everitt et al. (2017) investigated the use of exact-approximate importance sampling (IS) and sequential Monte Carlo (SMC) in doubly intractable problems, but focussed only on SMC algorithms that used data-point tempering. This paper describes SMC samplers that may use alternative sequences of distributions, and describes ways in which likelihood estimates may be improved adaptively as the algorithm progresses, building on ideas from Moores et al. (2015). This approach is compared with a number of alternative algorithms for doubly intractable problems, including approximate Bayesian computation (ABC), which we show is closely related to the method of Møller et al. (2006).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2017

Improving approximate Bayesian computation via quasi Monte Carlo

ABC (approximate Bayesian computation) is a general approach for dealing...
research
04/27/2023

Resampling Gradients Vanish in Differentiable Sequential Monte Carlo Samplers

Annealed Importance Sampling (AIS) moves particles along a Markov chain ...
research
11/03/2022

Rare event ABC-SMC^2

Approximate Bayesian computation (ABC) is a well-established family of M...
research
04/01/2015

Bayesian model comparison with un-normalised likelihoods

Models for which the likelihood function can be evaluated only up to a p...
research
09/22/2017

Barker's algorithm for Bayesian inference with intractable likelihoods

In this expository paper we abstract and describe a simple MCMC scheme f...
research
05/18/2022

Marginal and Joint Cross-Entropies Predictives for Online Bayesian Inference, Active Learning, and Active Sampling

Principled Bayesian deep learning (BDL) does not live up to its potentia...
research
03/06/2023

Properties of Marginal Sequential Monte Carlo Methods

We provide a framework which admits a number of “marginal” sequential Mo...

Please sign up or login with your details

Forgot password? Click here to reset