Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited

06/14/2023
by   Lu Yu, et al.
0

We revisit the problem of sampling from a target distribution that has a smooth strongly log-concave density everywhere in ℝ^p. In this context, if no additional density information is available, the randomized midpoint discretization for the kinetic Langevin diffusion is known to be the most scalable method in high dimensions with large condition numbers. Our main result is a nonasymptotic and easy to compute upper bound on the Wasserstein-2 error of this method. To provide a more thorough explanation of our method for establishing the computable upper bound, we conduct an analysis of the midpoint discretization for the vanilla Langevin process. This analysis helps to clarify the underlying principles and provides valuable insights that we use to establish an improved upper bound for the kinetic Langevin process with the midpoint discretization. Furthermore, by applying these techniques we establish new guarantees for the kinetic Langevin process with Euler discretization, which have a better dependence on the condition number than existing upper bounds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2018

On sampling from a log-concave density using kinetic Langevin diffusions

Langevin diffusion processes and their discretizations are often used fo...
research
06/20/2019

Bounding the error of discretized Langevin algorithms for non-strongly log-concave targets

In this paper, we provide non-asymptotic upper bounds on the error of sa...
research
06/24/2020

Penalized Langevin dynamics with vanishing penalty for smooth and log-concave targets

We study the problem of sampling from a probability distribution on ℝ^p ...
research
07/10/2021

Convergence Analysis of Schrödinger-Föllmer Sampler without Convexity

Schrödinger-Föllmer sampler (SFS) is a novel and efficient approach for ...
research
02/08/2016

Guarantees in Wasserstein Distance for the Langevin Monte Carlo Algorithm

We study the problem of sampling from a distribution using the Langevin...
research
02/04/2019

Non-asymptotic Results for Langevin Monte Carlo: Coordinate-wise and Black-box Sampling

Euler-Maruyama and Ozaki discretization of a continuous time diffusion p...
research
12/23/2014

Theoretical guarantees for approximate sampling from smooth and log-concave densities

Sampling from various kinds of distributions is an issue of paramount im...

Please sign up or login with your details

Forgot password? Click here to reset