Hamiltonian zigzag sampler got more momentum than its Markovian counterpart: Equivalence of two zigzags under a momentum refreshment limit

04/15/2021
by   Akihiko Nishimura, et al.
0

Zigzag and other piecewise deterministic Markov process samplers have attracted significant interest for their non-reversibility and other appealing properties for Bayesian posterior computation. Hamiltonian Monte Carlo is another state-of-the-art sampler, exploiting fictitious momentum to guide Markov chains through complex target distributions. In this article, we uncover a remarkable connection between the zigzag sampler and a variant of Hamiltonian Monte Carlo exploiting Laplace-distributed momentum. The position and velocity component of the corresponding Hamiltonian dynamics travels along a zigzag path paralleling the Markovian zigzag process; however, the dynamics is non-Markovian as the momentum component encodes non-immediate pasts. This information is partially lost during a momentum refreshment step, in which we preserve its direction but re-sample magnitude. In the limit of increasingly frequent momentum refreshments, we prove that this Hamiltonian zigzag converges to its Markovian counterpart. This theoretical insight suggests that, by retaining full momentum information, Hamiltonian zigzag can better explore target distributions with highly correlated parameters. We corroborate this intuition by comparing performance of the two zigzag cousins on high-dimensional truncated multivariate Gaussians, including a 11,235-dimensional target arising from a Bayesian phylogenetic multivariate probit model applied to HIV virus data.

READ FULL TEXT

page 3

page 35

research
08/13/2018

Randomized Hamiltonian Monte Carlo as Scaling Limit of the Bouncy Particle Sampler and Dimension-Free Convergence Rates

The Bouncy Particle Sampler is a Markov chain Monte Carlo method based o...
research
09/11/2019

Exploring Discrete Analogs of Hamiltonian Monte Carlo

Hamiltonian Monte Carlo (HMC) has emerged as a powerful way to sample fr...
research
12/15/2021

The Apogee to Apogee Path Sampler

Amongst Markov chain Monte Carlo algorithms, Hamiltonian Monte Carlo (HM...
research
10/21/2022

Adaptive Tuning for Metropolis Adjusted Langevin Trajectories

Hamiltonian Monte Carlo (HMC) is a widely used sampler for continuous pr...
research
09/23/2022

hdtg: An R package for high-dimensional truncated normal simulation

Simulating from the multivariate truncated normal distribution (MTN) is ...
research
10/21/2021

Hamiltonian Monte Carlo with Asymmetrical Momentum Distributions

Existing rigorous convergence guarantees for the Hamiltonian Monte Carlo...
research
11/02/2019

Implicit Hamiltonian Monte Carlo for Sampling Multiscale Distributions

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics ...

Please sign up or login with your details

Forgot password? Click here to reset