Implicit Langevin Algorithms for Sampling From Log-concave Densities

03/29/2019
by   Liam Hodgkinson, et al.
0

For sampling from a log-concave density, we study implicit integrators resulting from θ-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the resulting sampling methods for θ∈ [0,1] and a range of step sizes are established. Our results generalize and extend prior works in several directions. In particular, for θ>1/2, we prove geometric ergodicity and stability of the resulting methods for all step sizes. We show that obtaining subsequent samples amounts to solving a strongly-convex optimization problem, which is readily achievable using one of numerous existing methods. Numerical examples supporting our theoretical analysis are also presented.

READ FULL TEXT
research
01/08/2018

Log-concave sampling: Metropolis-Hastings algorithms are fast!

We consider the problem of sampling from a strongly log-concave density ...
research
02/10/2022

Towards a Theory of Non-Log-Concave Sampling: First-Order Stationarity Guarantees for Langevin Monte Carlo

For the task of sampling from a density π∝exp(-V) on ℝ^d, where V is pos...
research
12/13/2018

A Polynomial Time Algorithm for Maximum Likelihood Estimation of Multivariate Log-concave Densities

We study the problem of computing the maximum likelihood estimator (MLE)...
research
06/10/2022

Log-concave density estimation in undirected graphical models

We study the problem of maximum likelihood estimation of densities that ...
research
10/30/2020

Efficient constrained sampling via the mirror-Langevin algorithm

We propose a new discretization of the mirror-Langevin diffusion and giv...
research
05/31/2023

Conditionally Strongly Log-Concave Generative Models

There is a growing gap between the impressive results of deep image gene...
research
12/24/2022

Concentration of the Langevin Algorithm's Stationary Distribution

A canonical algorithm for log-concave sampling is the Langevin Algorithm...

Please sign up or login with your details

Forgot password? Click here to reset