Geometrically adapted Langevin dynamics for Markov chain Monte Carlo simulations

01/20/2022
by   Mariya Mamajiwala, et al.
0

Markov Chain Monte Carlo (MCMC) is one of the most powerful methods to sample from a given probability distribution, of which the Metropolis Adjusted Langevin Algorithm (MALA) is a variant wherein the gradient of the distribution is used towards faster convergence. However, being set up in the Euclidean framework, MALA might perform poorly in higher dimensional problems or in those involving anisotropic densities as the underlying non-Euclidean aspects of the geometry of the sample space remain unaccounted for. We make use of concepts from differential geometry and stochastic calculus on Riemannian manifolds to geometrically adapt a stochastic differential equation with a non-trivial drift term. This adaptation is also referred to as a stochastic development. We apply this method specifically to the Langevin diffusion equation and arrive at a geometrically adapted Langevin dynamics. This new approach far outperforms MALA, certain manifold variants of MALA, and other approaches such as Hamiltonian Monte Carlo (HMC), its adaptive variant the no-U-turn sampler (NUTS) implemented in Stan, especially as the dimension of the problem increases where often GALA is actually the only successful method. This is evidenced through several numerical examples that include parameter estimation of a broad class of probability distributions and a logistic regression problem.

READ FULL TEXT
research
07/05/2021

Antithetic Riemannian Manifold And Quantum-Inspired Hamiltonian Monte Carlo

Markov Chain Monte Carlo inference of target posterior distributions in ...
research
11/04/2019

Gradient-based Adaptive Markov Chain Monte Carlo

We introduce a gradient-based learning method to automatically adapt Mar...
research
05/08/2017

Geometry and Dynamics for Markov Chain Monte Carlo

Markov Chain Monte Carlo methods have revolutionised mathematical comput...
research
09/21/2023

Estimating Stable Fixed Points and Langevin Potentials for Financial Dynamics

The Geometric Brownian Motion (GBM) is a standard model in quantitative ...
research
02/01/2022

Lagrangian Manifold Monte Carlo on Monge Patches

The efficiency of Markov Chain Monte Carlo (MCMC) depends on how the und...
research
12/17/2020

A fresh take on 'Barker dynamics' for MCMC

We study a recently introduced gradient-based Markov chain Monte Carlo m...
research
08/21/2023

Monte Carlo on manifolds in high dimensions

We introduce an efficient numerical implementation of a Markov Chain Mon...

Please sign up or login with your details

Forgot password? Click here to reset