Proximal Langevin Algorithm: Rapid Convergence Under Isoperimetry

11/04/2019
by   Andre Wibisono, et al.
0

We study the Proximal Langevin Algorithm (PLA) for sampling from a probability distribution ν = e^-f on R^n under isoperimetry. We prove a convergence guarantee for PLA in Kullback-Leibler (KL) divergence when ν satisfies log-Sobolev inequality (LSI) and f has bounded second and third derivatives. This improves on the result for the Unadjusted Langevin Algorithm (ULA), and matches the fastest known rate for sampling under LSI (without Metropolis filter) with a better dependence on the LSI constant. We also prove convergence guarantees for PLA in Rényi divergence of order q > 1 when the biased limit satisfies either LSI or Poincaré inequality.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/20/2019

Rapid Convergence of the Unadjusted Langevin Algorithm: Log-Sobolev Suffices

We prove a convergence guarantee on the unadjusted Langevin algorithm fo...
research
11/02/2022

Convergence in KL Divergence of the Inexact Langevin Algorithm with Application to Score-based Generative Models

We study the Inexact Langevin Algorithm (ILA) for sampling using estimat...
research
10/11/2020

Fast Convergence of Langevin Dynamics on Manifold: Geodesics meet Log-Sobolev

Sampling is a fundamental and arguably very important task with numerous...
research
01/09/2018

Better and Simpler Error Analysis of the Sinkhorn-Knopp Algorithm for Matrix Scaling

Given a non-negative n × m real matrix A, the matrix scaling problem is...
research
07/22/2020

A Brief Note on the Convergence of Langevin Monte Carlo in Chi-Square Divergence

We study sampling from a target distribution ν_* ∝ e^-f using the unadju...
research
10/14/2018

Bregman Divergence Bounds and the Universality of the Logarithmic Loss

A loss function measures the discrepancy between the true values and the...
research
02/13/2022

Improved analysis for a proximal algorithm for sampling

We study the proximal sampler of Lee, Shen, and Tian (2021) and obtain n...

Please sign up or login with your details

Forgot password? Click here to reset