Transport map unadjusted Langevin algorithms

02/14/2023
by   Benjamin J. Zhang, et al.
0

Langevin dynamics are widely used in sampling high-dimensional, non-Gaussian distributions whose densities are known up to a normalizing constant. In particular, there is strong interest in unadjusted Langevin algorithms (ULA), which directly discretize Langevin dynamics to estimate expectations over the target distribution. We study the use of transport maps that approximately normalize a target distribution as a way to precondition and accelerate the convergence of Langevin dynamics. We show that in continuous time, when a transport map is applied to Langevin dynamics, the result is a Riemannian manifold Langevin dynamics (RMLD) with metric defined by the transport map. This connection suggests more systematic ways of learning metrics, and also yields alternative discretizations of the RMLD described by the map, which we study. Moreover, we show that under certain conditions, when the transport map is used in conjunction with ULA, we can improve the geometric rate of convergence of the output process in the 2–Wasserstein distance. Illustrative numerical results complement our theoretical claims.

READ FULL TEXT

page 18

page 19

research
08/09/2021

Scalable Bayesian transport maps for high-dimensional non-Gaussian spatial fields

A multivariate distribution can be described by a triangular transport m...
research
03/17/2023

Limit theorems for semidiscrete optimal transport maps

We study statistical inference for the optimal transport (OT) map (also ...
research
02/27/2023

An Approximation Theory Framework for Measure-Transport Sampling Algorithms

This article presents a general approximation-theoretic framework to ana...
research
07/18/2019

A geometric approach to the transport of discontinuous densities

Different observations of a relation between inputs ("sources") and outp...
research
12/12/2017

Transportation analysis of denoising autoencoders: a novel method for analyzing deep neural networks

The feature map obtained from the denoising autoencoder (DAE) is investi...
research
08/19/2023

Transporting Higher-Order Quadrature Rules: Quasi-Monte Carlo Points and Sparse Grids for Mixture Distributions

Integration against, and hence sampling from, high-dimensional probabili...
research
05/23/2018

The Vector Heat Method

This paper describes a method for efficiently computing parallel transpo...

Please sign up or login with your details

Forgot password? Click here to reset