The Forward-Backward Envelope for Sampling with the Overdamped Langevin Algorithm

01/22/2022
by   Armin Eftekhari, et al.
0

In this paper, we analyse a proximal method based on the idea of forward-backward splitting for sampling from distributions with densities that are not necessarily smooth. In particular, we study the non-asymptotic properties of the Euler-Maruyama discretization of the Langevin equation, where the forward-backward envelope is used to deal with the non-smooth part of the dynamics. An advantage of this envelope, when compared to widely-used Moreu-Yoshida one and the MYULA algorithm, is that it maintains the MAP estimator of the original non-smooth distribution. We also study a number of numerical experiments that corroborate that support our theoretical findings.

READ FULL TEXT

page 19

page 20

research
11/06/2019

Error estimates for backward fractional Feynman-Kac equation with non-smooth initial data

In this paper, we are concerned with the numerical solution for the back...
research
10/30/2019

Distributed forward-backward (half) forward algorithms for generalized Nash equilibrium seeking

We present two distributed algorithms for the computation of a generaliz...
research
10/01/2019

An Efficient Sampling Algorithm for Non-smooth Composite Potentials

We consider the problem of sampling from a density of the form p(x) ∝(-f...
research
02/07/2020

Wasserstein Proximal Gradient

We consider the task of sampling from a log-concave probability distribu...
research
02/22/2018

Sampling as optimization in the space of measures: The Langevin dynamics as a composite optimization problem

We study sampling as optimization in the space of measures. We focus on ...
research
03/11/2020

Interpolated Adjoint Method for Neural ODEs

In this paper, we propose a method, which allows us to alleviate or comp...
research
11/09/2022

Limit theorems for forward and backward processes of numbers of non-empty urns in infinite urn schemes

We study the joint asymptotics of forward and backward processes of numb...

Please sign up or login with your details

Forgot password? Click here to reset