Optimal friction matrix for underdamped Langevin sampling

11/30/2021
by   Martin Chak, et al.
0

A systematic procedure for optimising the friction coefficient in underdamped Langevin dynamics as a sampling tool is given by taking the gradient of the associated asymptotic variance with respect to friction. We give an expression for this gradient in terms of the solution to an appropriate Poisson equation and show that it can be approximated by short simulations of the associated first variation/tangent process under concavity assumptions on the log density. Our algorithm is applied to the estimation of posterior means in Bayesian inference problems and reduced variance is demonstrated when compared to the original underdamped and overdamped Langevin dynamics in both full and stochastic gradient cases.

READ FULL TEXT
research
03/30/2022

Improved Convergence Rate of Stochastic Gradient Langevin Dynamics with Variance Reduction and its Application to Optimization

The stochastic gradient Langevin Dynamics is one of the most fundamental...
research
06/16/2017

Control Variates for Stochastic Gradient MCMC

It is well known that Markov chain Monte Carlo (MCMC) methods scale poor...
research
10/04/2019

Nonasymptotic estimates for Stochastic Gradient Langevin Dynamics under local conditions in nonconvex optimization

Within the context of empirical risk minimization, see Raginsky, Rakhlin...
research
12/04/2017

Natural Langevin Dynamics for Neural Networks

One way to avoid overfitting in machine learning is to use model paramet...
research
06/22/2021

Choice of Damping Coefficient in Langevin Dynamics

This article considers the application of Langevin dynamics to sampling ...
research
11/20/2021

Bayesian Learning via Neural Schrödinger-Föllmer Flows

In this work we explore a new framework for approximate Bayesian inferen...
research
08/21/2021

Post-Processed Posteriors for Sparse Covariances and Its Application to Global Minimum Variance Portfolio

We consider Bayesian inference of sparse covariance matrices and propose...

Please sign up or login with your details

Forgot password? Click here to reset