Generalized Iterative Scaling for Regularized Optimal Transport with Affine Constraints: Application Examples

05/11/2023
by   Johannes von Lindheim, et al.
0

We demonstrate the relevance of an algorithm called generalized iterative scaling (GIS) or simultaneous multiplicative algebraic reconstruction technique (SMART) and its rescaled block-iterative version (RBI-SMART) in the field of optimal transport (OT). Many OT problems can be tackled through the use of entropic regularization by solving the Schrödinger problem, which is an information projection problem, that is, with respect to the Kullback–Leibler divergence. Here we consider problems that have several affine constraints. It is well-known that cyclic information projections onto the individual affine sets converge to the solution. In practice, however, even these individual projections are not explicitly available in general. In this paper, we exchange them for one GIS iteration. If this is done for every affine set, we obtain RBI-SMART. We provide a convergence proof using an interpretation of these iterations as two-step affine projections in an equivalent problem. This is done in a slightly more general setting than RBI-SMART, since we use a mix of explicitly known information projections and GIS iterations. We proceed to specialize this algorithm to several OT applications. First, we find the measure that minimizes the regularized OT divergence to a given measure under moment constraints. Second and third, the proposed framework yields an algorithm for solving a regularized martingale OT problem, as well as a relaxed version of the barycentric weak OT problem. Finally, we show an approach from the literature for unbalanced OT problems.

READ FULL TEXT

page 7

page 16

page 19

page 30

research
12/01/2021

Convergence of Batch Greenkhorn for Regularized Multimarginal Optimal Transport

In this work we propose a batch version of the Greenkhorn algorithm for ...
research
10/20/2016

Regularized Optimal Transport and the Rot Mover's Distance

This paper presents a unified framework for smooth convex regularization...
research
05/29/2021

Optimal transport with f-divergence regularization and generalized Sinkhorn algorithm

Entropic regularization provides a generalization of the original optima...
research
06/26/2020

Relaxed regularization for linear inverse problems

We consider regularized least-squares problems of the form min_x1/2‖ Ax ...
research
06/17/2019

Logarithmic divergences: geometry and interpretation of curvature

We study the logarithmic L^(α)-divergence which extrapolates the Bregman...
research
10/08/2016

Iterative proportional scaling revisited: a modern optimization perspective

This paper revisits the classic iterative proportional scaling (IPS) fro...
research
03/10/2021

Fast block-coordinate Frank-Wolfe algorithm for semi-relaxed optimal transport

Optimal transport (OT), which provides a distance between two probabilit...

Please sign up or login with your details

Forgot password? Click here to reset