Randomized Time Riemannian Manifold Hamiltonian Monte Carlo

06/09/2022
by   Peter A. Whalley, et al.
0

Hamiltonian Monte Carlo (HMC) algorithms which combine numerical approximation of Hamiltonian dynamics on finite intervals with stochastic refreshment and Metropolis correction are popular sampling schemes, but it is known that they may suffer from slow convergence in the continuous time limit. A recent paper of Bou-Rabee and Sanz-Serna (Ann. Appl. Prob., 27:2159-2194, 2017) demonstrated that this issue can be addressed by simply randomizing the duration parameter of the Hamiltonian paths. In this article, we use the same idea to enhance the sampling efficiency of a constrained version of HMC, with potential benefits in a variety of application settings. We demonstrate both the conservation of the stationary distribution and the ergodicity of the method. We also compare the performance of various schemes in numerical studies of model problems, including an application to high-dimensional covariance estimation.

READ FULL TEXT

page 22

page 27

page 28

page 29

research
08/27/2021

An Introduction to Hamiltonian Monte Carlo Method for Sampling

The goal of this article is to introduce the Hamiltonian Monte Carlo (HM...
research
02/25/2016

Towards Unifying Hamiltonian Monte Carlo and Slice Sampling

We unify slice sampling and Hamiltonian Monte Carlo (HMC) sampling, demo...
research
03/28/2023

Unbiasing Hamiltonian Monte Carlo algorithms for a general Hamiltonian function

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that ...
research
02/14/2021

Evaluating the Implicit Midpoint Integrator for Riemannian Manifold Hamiltonian Monte Carlo

Riemannian manifold Hamiltonian Monte Carlo is traditionally carried out...
research
02/03/2022

Sampling with Riemannian Hamiltonian Monte Carlo in a Constrained Space

We demonstrate for the first time that ill-conditioned, non-smooth, cons...
research
08/12/2022

Bayesian Inference with Latent Hamiltonian Neural Networks

When sampling for Bayesian inference, one popular approach is to use Ham...
research
12/31/2019

Interpretable Conservation Law Estimation by Deriving the Symmetries of Dynamics from Trained Deep Neural Networks

As deep neural networks (DNN) have the ability to model the distribution...

Please sign up or login with your details

Forgot password? Click here to reset