A stochastic Gauss-Newton algorithm for regularized semi-discrete optimal transport

07/12/2021
by   Bernard Bercu, et al.
0

We introduce a new second order stochastic algorithm to estimate the entropically regularized optimal transport cost between two probability measures. The source measure can be arbitrary chosen, either absolutely continuous or discrete, while the target measure is assumed to be discrete. To solve the semi-dual formulation of such a regularized and semi-discrete optimal transportation problem, we propose to consider a stochastic Gauss-Newton algorithm that uses a sequence of data sampled from the source measure. This algorithm is shown to be adaptive to the geometry of the underlying convex optimization problem with no important hyperparameter to be accurately tuned. We establish the almost sure convergence and the asymptotic normality of various estimators of interest that are constructed from this stochastic Gauss-Newton algorithm. We also analyze their non-asymptotic rates of convergence for the expected quadratic risk in the absence of strong convexity of the underlying objective function. The results of numerical experiments from simulated data are also reported to illustrate the finite sample properties of this Gauss-Newton algorithm for stochastic regularized optimal transport, and to show its advantages over the use of the stochastic gradient descent, stochastic Newton and ADAM algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2021

Semi-Discrete Optimal Transport: Hardness, Regularization and Numerical Solution

Semi-discrete optimal transport problems, which evaluate the Wasserstein...
research
12/21/2018

Asymptotic distribution and convergence rates of stochastic algorithms for entropic optimal transportation between probability measures

This paper is devoted to the stochastic approximation of entropically re...
research
02/02/2023

Stochastic optimal transport in Banach Spaces for regularized estimation of multivariate quantiles

We introduce a new stochastic algorithm for solving entropic optimal tra...
research
06/10/2020

Gradient Flows for Regularized Stochastic Control Problems

This work is motivated by a desire to extend the theoretical underpinnin...
research
01/20/2021

A Damped Newton Algorithm for Generated Jacobian Equations

Generated Jacobian Equations have been introduced by Trudinger [Disc. co...
research
11/17/2020

Asymptotics of Entropy-Regularized Optimal Transport via Chaos Decomposition

Consider the problem of estimating the optimal coupling (i.e., matching)...
research
03/14/2023

Fast Regularized Discrete Optimal Transport with Group-Sparse Regularizers

Regularized discrete optimal transport (OT) is a powerful tool to measur...

Please sign up or login with your details

Forgot password? Click here to reset