Log In Sign Up

Optimal transport with f-divergence regularization and generalized Sinkhorn algorithm

by   Dávid Terjék, et al.

Entropic regularization provides a generalization of the original optimal transport problem. It introduces a penalty term defined by the Kullback-Leibler divergence, making the problem more tractable via the celebrated Sinkhorn algorithm. Replacing the Kullback-Leibler divergence with a general f-divergence leads to a natural generalization. Using convex analysis, we extend the theory developed so far to include f-divergences defined by functions of Legendre type, and prove that under some mild conditions, strong duality holds, optimums in both the primal and dual problems are attained, the generalization of the c-transform is well-defined, and we give sufficient conditions for the generalized Sinkhorn algorithm to converge to an optimal solution. We propose a practical algorithm for computing the regularized optimal transport cost and its gradient via the generalized Sinkhorn algorithm. Finally, we present experimental results on synthetic 2-dimensional data, demonstrating the effects of using different f-divergences for regularization, which influences convergence speed, numerical stability and sparsity of the optimal coupling.


page 1

page 2

page 3

page 4


An Homogeneous Unbalanced Regularized Optimal Transport model with applications to Optimal Transport with Boundary

This work studies how the introduction of the entropic regularization te...

Handling Multiple Costs in Optimal Transport: Strong Duality and Efficient Computation

We introduce an extension of the optimal transportation (OT) problem whe...

Conformal Mirror Descent with Logarithmic Divergences

The logarithmic divergence is an extension of the Bregman divergence mot...

Multiview Sensing With Unknown Permutations: An Optimal Transport Approach

In several applications, including imaging of deformable objects while i...

Estimating 2-Sinkhorn Divergence between Gaussian Processes from Finite-Dimensional Marginals

Optimal Transport (OT) has emerged as an important computational tool in...

Robust computation of optimal transport by β-potential regularization

Optimal transport (OT) has become a widely used tool in the machine lear...

A Homotopy Algorithm for Optimal Transport

The optimal transport problem has many applications in machine learning,...