Analysis of Langevin Monte Carlo from Poincaré to Log-Sobolev

12/23/2021
by   Sinho Chewi, et al.
0

Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution π under the sole assumption that π satisfies a Poincaré inequality. Using this fact to provide guarantees for the discrete-time Langevin Monte Carlo (LMC) algorithm, however, is considerably more challenging due to the need for working with chi-squared or Rényi divergences, and prior works have largely focused on strongly log-concave targets. In this work, we provide the first convergence guarantees for LMC assuming that π satisfies either a Latała–Oleszkiewicz or modified log-Sobolev inequality, which interpolates between the Poincaré and log-Sobolev settings. Unlike prior works, our results allow for weak smoothness and do not require convexity or dissipativity conditions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2023

Improved Discretization Analysis for Underdamped Langevin Monte Carlo

Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample f...
research
02/08/2016

Guarantees in Wasserstein Distance for the Langevin Monte Carlo Algorithm

We study the problem of sampling from a distribution using the Langevin...
research
01/08/2023

Stochastic Langevin Monte Carlo for (weakly) log-concave posterior distributions

In this paper, we investigate a continuous time version of the Stochasti...
research
06/15/2023

Second order quantitative bounds for unadjusted generalized Hamiltonian Monte Carlo

This paper provides a convergence analysis for generalized Hamiltonian M...
research
03/20/2019

Rapid Convergence of the Unadjusted Langevin Algorithm: Log-Sobolev Suffices

We prove a convergence guarantee on the unadjusted Langevin algorithm fo...
research
05/30/2019

Langevin Monte Carlo without Smoothness

Langevin Monte Carlo (LMC) is an iterative algorithm used to generate sa...
research
10/30/2020

Efficient constrained sampling via the mirror-Langevin algorithm

We propose a new discretization of the mirror-Langevin diffusion and giv...

Please sign up or login with your details

Forgot password? Click here to reset