Exponential ergodicity of mirror-Langevin diffusions

05/19/2020
by   Sinho Chewi, et al.
0

Motivated by the problem of sampling from ill-conditioned log-concave distributions, we give a clean non-asymptotic convergence analysis of mirror-Langevin diffusions as introduced in Zhang et al. (2020). As a special case of this framework, we propose a class of diffusions called Newton-Langevin diffusions and prove that they converge to stationarity exponentially fast with a rate which not only is dimension-free, but also has no dependence on the target distribution. We give an application of this result to the problem of sampling from the uniform distribution on a convex body using a strategy inspired by interior-point methods. Our general approach follows the recent trend of linking sampling and optimization, and in particular, it yields new results on the convergence of the vanilla Langevin diffusion in Wasserstein distance.

READ FULL TEXT
research
10/19/2020

Faster Convergence of Stochastic Gradient Langevin Dynamics for Non-Log-Concave Sampling

We establish a new convergence analysis of stochastic gradient Langevin ...
research
02/08/2016

Guarantees in Wasserstein Distance for the Langevin Monte Carlo Algorithm

We study the problem of sampling from a distribution using the Langevin...
research
07/02/2020

Double-Loop Unadjusted Langevin Algorithm

A well-known first-order method for sampling from log-concave probabilit...
research
10/25/2019

Convergence Analysis of the Randomized Newton Method with Determinantal Sampling

We analyze the convergence rate of the Randomized Newton Method (RNM) in...
research
01/31/2022

L-SVRG and L-Katyusha with Adaptive Sampling

Stochastic gradient-based optimization methods, such as L-SVRG and its a...
research
06/29/2020

Spectral Gap of Replica Exchange Langevin Diffusion on Mixture Distributions

Langevin diffusion (LD) is one of the main workhorses for sampling probl...
research
06/23/2023

On a Class of Gibbs Sampling over Networks

We consider the sampling problem from a composite distribution whose pot...

Please sign up or login with your details

Forgot password? Click here to reset