Pseudo-extended Markov chain Monte Carlo

08/17/2017
by   Christopher Nemeth, et al.
0

Sampling from the posterior distribution using Markov chain Monte Carlo (MCMC) methods can require an exhaustive number of iterations to fully explore the correct posterior. This is often the case when the posterior of interest is multi-modal, as the MCMC sampler can become trapped in a local mode for a large number of iterations. In this paper, we introduce the pseudo-extended MCMC method as an approach for improving the mixing of the MCMC sampler in complex posterior distributions. The pseudo-extended method augments the state-space of the posterior using pseudo-samples as auxiliary variables, where on the extended space, the MCMC sampler is able to easily move between the well-separated modes of the posterior. We apply the pseudo-extended method within an Hamiltonian Monte Carlo sampler and show that by using the No U-turn algorithm (Hoffman and Gelman, 2014), our proposed sampler is completely tuning free. We compare the pseudo-extended method against well-known tempered MCMC algorithms and show the advantages of the new sampler on a number of challenging examples from the statistics literature.

READ FULL TEXT
research
08/05/2021

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler with a Near-Optimal L-Kernel

Markov Chain Monte Carlo (MCMC) is a powerful method for drawing samples...
research
04/08/2020

Posterior computation with the Gibbs zig-zag sampler

Markov chain Monte Carlo (MCMC) sampling algorithms have dominated the l...
research
11/26/2012

Bayesian learning of noisy Markov decision processes

We consider the inverse reinforcement learning problem, that is, the pro...
research
05/27/2016

Merging MCMC Subposteriors through Gaussian-Process Approximations

Markov chain Monte Carlo (MCMC) algorithms have become powerful tools fo...
research
02/10/2022

Order-based Structure Learning without Score Equivalence

We consider the structure learning problem with all node variables havin...
research
12/23/2022

Design of Hamiltonian Monte Carlo for perfect simulation of general continuous distributions

Hamiltonian Monte Carlo (HMC) is an efficient method of simulating smoot...
research
12/24/2021

Annealed Leap-Point Sampler for Multimodal Target Distributions

In Bayesian statistics, exploring multimodal posterior distribution pose...

Please sign up or login with your details

Forgot password? Click here to reset