Second order quantitative bounds for unadjusted generalized Hamiltonian Monte Carlo

06/15/2023
by   Evan Camrud, et al.
0

This paper provides a convergence analysis for generalized Hamiltonian Monte Carlo samplers, a family of Markov Chain Monte Carlo methods based on leapfrog integration of Hamiltonian dynamics and kinetic Langevin diffusion, that encompasses the unadjusted Hamiltonian Monte Carlo method. Assuming that the target distribution π satisfies a log-Sobolev inequality and mild conditions on the corresponding potential function, we establish quantitative bounds on the relative entropy of the iterates defined by the algorithm, with respect to π. Our approach is based on a perturbative and discrete version of the modified entropy method developed to establish hypocoercivity for the continuous-time kinetic Langevin process. As a corollary of our main result, we are able to derive complexity bounds for the class of algorithms at hand. In particular, we show that the total number of iterations to achieve a target accuracy ε >0 is of order d/ε^1/4, where d is the dimension of the problem. This result can be further improved in the case of weakly interacting mean field potentials, for which we find a total number of iterations of order (d/ε)^1/4.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/04/2020

Connecting the Dots: Towards Continuous Time Hamiltonian Monte Carlo

Continuous time Hamiltonian Monte Carlo is introduced, as a powerful alt...
research
05/03/2021

Mixing Time Guarantees for Unadjusted Hamiltonian Monte Carlo

We provide quantitative upper bounds on the total variation mixing time ...
research
03/17/2020

Mixing Rates for Hamiltonian Monte Carlo Algorithms in Finite and Infinite Dimensions

We establish the geometric ergodicity of the preconditioned Hamiltonian ...
research
06/28/2023

On the surprising effectiveness of a simple matrix exponential derivative approximation, with application to global SARS-CoV-2

The continuous-time Markov chain (CTMC) is the mathematical workhorse of...
research
10/11/2019

Maximizing conditional entropy of Hamiltonian Monte Carlo sampler

The performance of Hamiltonian Monte Carlo (HMC) sampler depends critica...
research
12/23/2021

Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev

Classically, the continuous-time Langevin diffusion converges exponentia...
research
11/17/2020

Convergence of Preconditioned Hamiltonian Monte Carlo on Hilbert Spaces

In this article, we consider the preconditioned Hamiltonian Monte Carlo ...

Please sign up or login with your details

Forgot password? Click here to reset