Unbalanced Optimal Transport through Non-negative Penalized Linear Regression

06/08/2021
by   Laetitia Chapel, et al.
0

This paper addresses the problem of Unbalanced Optimal Transport (UOT) in which the marginal conditions are relaxed (using weighted penalties in lieu of equality) and no additional regularization is enforced on the OT plan. In this context, we show that the corresponding optimization problem can be reformulated as a non-negative penalized linear regression problem. This reformulation allows us to propose novel algorithms inspired from inverse problems and nonnegative matrix factorization. In particular, we consider majorization-minimization which leads in our setting to efficient multiplicative updates for a variety of penalties. Furthermore, we derive for the first time an efficient algorithm to compute the regularization path of UOT with quadratic penalties. The proposed algorithm provides a continuity of piece-wise linear OT plans converging to the solution of balanced OT (corresponding to infinite penalty weights). We perform several numerical experiments on simulated and real data illustrating the new algorithms, and provide a detailed discussion about more sophisticated optimization tools that can further be used to solve OT problems thanks to our reformulation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2018

Blind Source Separation with Optimal Transport Non-negative Matrix Factorization

Optimal transport as a loss for machine learning optimization problems h...
research
04/10/2020

Full waveform inversion with unbalanced optimal transport distance

Full waveform inversion (FWI) is an important and popular technique in s...
research
02/15/2022

Accelerating Non-Negative and Bounded-Variable Linear Regression Algorithms with Safe Screening

Non-negative and bounded-variable linear regression problems arise in a ...
research
09/25/2019

Optimal Transport, CycleGAN, and Penalized LS for Unsupervised Learning in Inverse Problems

The penalized least squares (PLS) is a classic approach to inverse probl...
research
03/14/2023

An optimal transport regularized model to image reconstruction problems

Optimal transport problem has gained much attention in image processing ...
research
08/06/2018

A Survey on Surrogate Approaches to Non-negative Matrix Factorization

Motivated by applications in hyperspectral imaging we investigate method...

Please sign up or login with your details

Forgot password? Click here to reset