Markov chain Monte Carlo algorithms with sequential proposals

07/15/2019
by   Joonha Park, et al.
0

We explore a general framework in Markov chain Monte Carlo (MCMC) sampling where sequential proposals are tried as a candidate for the next state of the Markov chain. This sequential-proposal framework can be applied to various existing MCMC methods, including Metropolis-Hastings algorithms using random proposals and methods that use deterministic proposals such as Hamiltonian Monte Carlo or the bouncy particle sampler. Sequential-proposal MCMC methods construct the same Markov chains as those constructed by the delayed rejection method under certain circumstances. We demonstrate that applications of the sequential-proposal framework to Hamiltonian Monte Carlo (HMC) methods can lead to improved numerical efficiency compared to standard HMC methods and the No-U-Turn sampler. Finally, we show that the sequential-proposal bouncy particle sampler enables the constructed Markov chain to pass through regions of low target density and thus facilitates better mixing of the chain when the target density is multimodal.

READ FULL TEXT
research
08/05/2021

The No-U-Turn Sampler as a Proposal Distribution in a Sequential Monte Carlo Sampler with a Near-Optimal L-Kernel

Markov Chain Monte Carlo (MCMC) is a powerful method for drawing samples...
research
02/16/2016

Interacting Particle Markov Chain Monte Carlo

We introduce interacting particle Markov chain Monte Carlo (iPMCMC), a P...
research
10/20/2019

Cores for Piecewise-Deterministic Markov Processes used in Markov Chain Monte Carlo

This article provides a tool for the analysis of Piecewise-deterministic...
research
02/12/2018

Bouncy Hybrid Sampler as a Unifying Device

This work introduces a class of rejection-free Markov chain Monte Carlo ...
research
11/02/2021

Efficient Learning of the Parameters of Non-Linear Models using Differentiable Resampling in Particle Filters

It has been widely documented that the sampling and resampling steps in ...
research
05/13/2019

Replica Conditional Sequential Monte Carlo

We propose a Markov chain Monte Carlo (MCMC) scheme to perform state inf...
research
01/17/2020

Unit Testing for MCMC and other Monte Carlo Methods

We propose approaches for testing implementations of Markov Chain Monte ...

Please sign up or login with your details

Forgot password? Click here to reset