Implicit Hamiltonian Monte Carlo for Sampling Multiscale Distributions

11/02/2019
by   Arya A Pourzanjani, et al.
0

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics community because of its ability to sample high-dimensional distributions much more efficiently than other Metropolis-based methods. Despite this, HMC often performs sub-optimally on distributions with high correlations or marginal variances on multiple scales because the resulting stiffness forces the leapfrog integrator in HMC to take an unreasonably small stepsize. We provide intuition as well as a formal analysis showing how these multiscale distributions limit the stepsize of leapfrog and we show how the implicit midpoint method can be used, together with Newton-Krylov iteration, to circumvent this limitation and achieve major efficiency gains. Furthermore, we offer practical guidelines for when to choose between implicit midpoint and leapfrog and what stepsize to use for each method, depending on the distribution being sampled. Unlike previous modifications to HMC, our method is generally applicable to highly non-Gaussian distributions exhibiting multiple scales. We illustrate how our method can provide a dramatic speedup over leapfrog in the context of the No-U-Turn sampler (NUTS) applied to several examples.

READ FULL TEXT
research
10/01/2021

Delayed rejection Hamiltonian Monte Carlo for sampling multiscale distributions

The efficiency of Hamiltonian Monte Carlo (HMC) can suffer when sampling...
research
06/07/2018

A Spectral Approach to Gradient Estimation for Implicit Distributions

Recently there have been increasing interests in learning and inference ...
research
01/20/2022

Metropolis Augmented Hamiltonian Monte Carlo

Hamiltonian Monte Carlo (HMC) is a powerful Markov Chain Monte Carlo (MC...
research
03/28/2023

Unbiasing Hamiltonian Monte Carlo algorithms for a general Hamiltonian function

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that ...
research
09/23/2022

hdtg: An R package for high-dimensional truncated normal simulation

Simulating from the multivariate truncated normal distribution (MTN) is ...

Please sign up or login with your details

Forgot password? Click here to reset