On Numerical Considerations for Riemannian Manifold Hamiltonian Monte Carlo

11/19/2021
by   James A. Brofos, et al.
0

Riemannian manifold Hamiltonian Monte Carlo (RMHMC) is a sampling algorithm that seeks to adapt proposals to the local geometry of the posterior distribution. The specific form of the Hamiltonian used in RMHMC necessitates implicitly-defined numerical integrators in order to sustain reversibility and volume-preservation, two properties that are necessary to establish detailed balance of RMHMC. In practice, these implicit equations are solved to a non-zero convergence tolerance via fixed-point iteration. However, the effect of these convergence thresholds on the ergodicity and computational efficiency properties of RMHMC are not well understood. The purpose of this research is to elucidate these relationships through numerous case studies. Our analysis reveals circumstances wherein the RMHMC algorithm is sensitive, and insensitive, to these convergence tolerances. Our empirical analysis examines several aspects of the computation: (i) we examine the ergodicity of the RMHMC Markov chain by employing statistical methods for comparing probability measures based on collections of samples; (ii) we investigate the degree to which detailed balance is violated by measuring errors in reversibility and volume-preservation; (iii) we assess the efficiency of the RMHMC Markov chain in terms of time-normalized ESS. In each of these cases, we investigate the sensitivity of these metrics to the convergence threshold and further contextualize our results in terms of comparison against Euclidean HMC. We propose a method by which one may select the convergence tolerance within a Bayesian inference application using techniques of stochastic approximation and we examine Newton's method, an alternative to fixed point iterations, which can eliminate much of the sensitivity of RMHMC to the convergence threshold.

READ FULL TEXT
research
02/14/2021

Evaluating the Implicit Midpoint Integrator for Riemannian Manifold Hamiltonian Monte Carlo

Riemannian manifold Hamiltonian Monte Carlo is traditionally carried out...
research
02/28/2022

Several Remarks on the Numerical Integrator in Lagrangian Monte Carlo

Riemannian manifold Hamiltonian Monte Carlo (RMHMC) is a powerful method...
research
03/28/2023

Unbiasing Hamiltonian Monte Carlo algorithms for a general Hamiltonian function

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that ...
research
10/21/2022

Barrier Hamiltonian Monte Carlo

In this paper, we propose Barrier Hamiltonian Monte Carlo (BHMC), a vers...
research
02/12/2022

Adaptive truncation of infinite sums: applications to Statistics

It is often the case in Statistics that one needs to compute sums of inf...
research
10/14/2019

Introducing an Explicit Symplectic Integration Scheme for Riemannian Manifold Hamiltonian Monte Carlo

We introduce a recent symplectic integration scheme derived for solving ...
research
12/05/2017

Posterior Integration on a Riemannian Manifold

The geodesic Markov chain Monte Carlo method and its variants enable com...

Please sign up or login with your details

Forgot password? Click here to reset