Penalized Langevin dynamics with vanishing penalty for smooth and log-concave targets

06/24/2020
by   Avetik Karagulyan, et al.
0

We study the problem of sampling from a probability distribution on ℝ^p defined via a convex and smooth potential function. We consider a continuous-time diffusion-type process, termed Penalized Langevin dynamics (PLD), the drift of which is the negative gradient of the potential plus a linear penalty that vanishes when time goes to infinity. An upper bound on the Wasserstein-2 distance between the distribution of the PLD at time t and the target is established. This upper bound highlights the influence of the speed of decay of the penalty on the accuracy of the approximation. As a consequence, considering the low-temperature limit we infer a new nonasymptotic guarantee of convergence of the penalized gradient flow for the optimization problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/29/2022

Penalized Langevin and Hamiltonian Monte Carlo Algorithms for Constrained Sampling

We consider the constrained sampling problem where the goal is to sample...
research
06/14/2023

Langevin Monte Carlo for strongly log-concave distributions: Randomized midpoint revisited

We revisit the problem of sampling from a target distribution that has a...
research
06/11/2020

Improved Algorithms for Convex-Concave Minimax Optimization

This paper studies minimax optimization problems min_x max_y f(x,y), whe...
research
12/23/2020

Optimal dimension dependence of the Metropolis-Adjusted Langevin Algorithm

Conventional wisdom in the sampling literature, backed by a popular diff...
research
09/04/2023

Smoothing ADMM for Sparse-Penalized Quantile Regression with Non-Convex Penalties

This paper investigates quantile regression in the presence of non-conve...
research
05/04/2018

Sharp Convergence Rates for Langevin Dynamics in the Nonconvex Setting

We study the problem of sampling from a distribution where the negative ...
research
04/26/2023

A Statistical Interpretation of the Maximum Subarray Problem

Maximum subarray is a classical problem in computer science that given a...

Please sign up or login with your details

Forgot password? Click here to reset