A new method for determining Wasserstein 1 optimal transport maps from Kantorovich potentials, with deep learning applications

11/02/2022
by   Tristan Milne, et al.
0

Wasserstein 1 optimal transport maps provide a natural correspondence between points from two probability distributions, μ and ν, which is useful in many applications. Available algorithms for computing these maps do not appear to scale well to high dimensions. In deep learning applications, efficient algorithms have been developed for approximating solutions of the dual problem, known as Kantorovich potentials, using neural networks (e.g. [Gulrajani et al., 2017]). Importantly, such algorithms work well in high dimensions. In this paper we present an approach towards computing Wasserstein 1 optimal transport maps that relies only on Kantorovich potentials. In general, a Wasserstein 1 optimal transport map is not unique and is not computable from a potential alone. Our main result is to prove that if μ has a density and ν is supported on a submanifold of codimension at least 2, an optimal transport map is unique and can be written explicitly in terms of a potential. These assumptions are natural in many image processing contexts and other applications. When the Kantorovich potential is only known approximately, our result motivates an iterative procedure wherein data is moved in optimal directions and with the correct average displacement. Since this provides an approach for transforming one distribution to another, it can be used as a multipurpose algorithm for various transport problems; we demonstrate through several proof of concept experiments that this algorithm successfully performs various imaging tasks, such as denoising, generation, translation and deblurring, which normally require specialized techniques.

READ FULL TEXT

page 6

page 7

page 8

page 21

page 22

page 23

page 24

page 25

research
02/17/2021

A Consistent Extension of Discrete Optimal Transport Maps for Machine Learning Applications

Optimal transport maps define a one-to-one correspondence between probab...
research
10/21/2022

On amortizing convex conjugates for optimal transport

This paper focuses on computing the convex conjugate operation that aris...
research
11/30/2021

Trust the Critics: Generatorless and Multipurpose WGANs with Initial Convergence Guarantees

Inspired by ideas from optimal transport theory we present Trust the Cri...
research
05/26/2019

Regularity as Regularization: Smooth and Strongly Convex Brenier Potentials in Optimal Transport

The problem of estimating Wasserstein distances in high-dimensional spac...
research
02/12/2018

A Fast Proximal Point Method for Wasserstein Distance

Wasserstein distance plays increasingly important roles in machine learn...
research
04/15/2021

Iterative Barycenter Flows

The task of mapping two or more distributions to a shared representation...
research
05/27/2022

Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport

The problem of optimization on Stiefel manifold, i.e., minimizing functi...

Please sign up or login with your details

Forgot password? Click here to reset