A Fast and Accurate Splitting Method for Optimal Transport: Analysis and Implementation

10/22/2021
by   Vien V. Mai, et al.
0

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the original OT problem directly instead of solving an approximate regularized problem, as many state-of-the-art techniques do. This allows us to provide sparse transport plans and avoid numerical issues of methods that use entropic regularization. The algorithm has the same cost per iteration as the popular Sinkhorn method, and each iteration can be executed efficiently, in parallel. The proposed method enjoys an iteration complexity O(1/ϵ) compared to the best-known O(1/ϵ^2) of the Sinkhorn method. In addition, we establish a linear convergence rate for our formulation of the OT problem. We detail an efficient GPU implementation of the proposed method that maintains a primal-dual stopping criterion at no extra cost. Substantial experiments demonstrate the effectiveness of our method, both in terms of computation times and robustness.

READ FULL TEXT

page 9

page 12

research
05/29/2023

Bringing regularized optimal transport to lightspeed: a splitting method adapted for GPUs

We present an efficient algorithm for regularized optimal transport. In ...
research
02/09/2020

On Unbalanced Optimal Transport: An Analysis of Sinkhorn Algorithm

We provide a computational complexity analysis for the Sinkhorn algorith...
research
03/02/2022

An Accelerated Stochastic Algorithm for Solving the Optimal Transport Problem

We propose a novel accelerated stochastic algorithm – primal-dual accele...
research
06/09/2019

Accelerated Alternating Minimization

Alternating minimization (AM) optimization algorithms have been known fo...
research
03/22/2021

Selective information exchange in collaborative clustering using regularized Optimal Transport

Collaborative learning has recently achieved very significant results. I...
research
08/16/2022

An Optimal Transport Approach to the Computation of the LM Rate

Mismatch capacity characterizes the highest information rate for a chann...
research
06/06/2019

Primal-Dual Block Frank-Wolfe

We propose a variant of the Frank-Wolfe algorithm for solving a class of...

Please sign up or login with your details

Forgot password? Click here to reset