Genetic column generation: Fast computation of high-dimensional multi-marginal optimal transport problems

03/23/2021
by   Gero Friesecke, et al.
0

We introduce a simple, accurate, and extremely efficient method for numerically solving the multi-marginal optimal transport (MMOT) problems arising in density functional theory. The method relies on (i) the sparsity of optimal plans [for N marginals discretized by ℓ gridpoints each, general Kantorovich plans require ℓ^N gridpoints but the support of optimizers is of size O(ℓ· N) [FV18]], (ii) the method of column generation (CG) from discrete optimization which to our knowledge has not hitherto been used in MMOT, and (iii) ideas from machine learning. The well-known bottleneck in CG consists in generating new candidate columns efficiently; we prove that in our context, finding the best new column is an NP-complete problem. To overcome this bottleneck we use a genetic learning method tailormade for MMOT in which the dual state within CG plays the role of an "adversary", in loose similarity to Wasserstein GANs. On a sequence of benchmark problems with up to 120 gridpoints and up to 30 marginals, our method always found the exact optimizers. Moreover, empirically the number of computational steps needed to find them appears to scale only polynomially when both N and ℓ are simultaneously increased (while keeping their ratio fixed to mimic a thermodynamic limit of the particle system).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2023

Convergence proof for the GenCol algorithm in the case of two-marginal optimal transport

The recently introduced Genetic Column Generation (GenCol) algorithm has...
research
09/19/2022

The GenCol algorithm for high-dimensional optimal transport: general formulation and application to barycenters and Wasserstein splines

We extend the recently introduced genetic column generation algorithm fo...
research
08/05/2022

Efficient and Exact Multimarginal Optimal Transport with Pairwise Costs

In this paper, we address the numerical solution to the multimarginal op...
research
02/05/2021

Constrained overdamped Langevin dynamics for symmetric multimarginal optimal transportation

The Strictly Correlated Electrons (SCE) limit of the Levy-Lieb functiona...
research
02/15/2022

Low-rank tensor approximations for solving multi-marginal optimal transport problems

By adding entropic regularization, multi-marginal optimal transport prob...
research
10/01/2021

Factored couplings in multi-marginal optimal transport via difference of convex programming

Optimal transport (OT) theory underlies many emerging machine learning (...

Please sign up or login with your details

Forgot password? Click here to reset