Projection Robust Wasserstein Barycenter

02/05/2021
by   Minhui Huang, et al.
0

Collecting and aggregating information from several probability measures or histograms is a fundamental task in machine learning. One of the popular solution methods for this task is to compute the barycenter of the probability measures under the Wasserstein metric. However, approximating the Wasserstein barycenter is numerically challenging because of the curse of dimensionality. This paper proposes the projection robust Wasserstein barycenter (PRWB) that mitigates the curse of dimensionality. This new model projects the probability measures onto a lower-dimensional subspace that maximizes the Wasserstein barycenter objective. The resulting problem is a max-min problem over the Stiefel manifold, which is numerically challenging in practice. Combining the iterative Bregman projection algorithm and Riemannian optimization, we propose two new algorithms for computing the PRWB. The complexity of arithmetic operations of the proposed algorithms for obtaining an ϵ-stationary solution is analyzed. We incorporate the PRWB into a discrete distribution clustering algorithm, and the numerical results on real text datasets confirm that our PRWB model helps improve the clustering performance significantly.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/09/2020

A Riemannian Block Coordinate Descent Method for Computing the Projection Robust Wasserstein Distance

The Wasserstein distance has become increasingly important in machine le...
06/11/2020

Stochastic Saddle-Point Optimization for Wasserstein Barycenters

We study the computation of non-regularized Wasserstein barycenters of p...
06/12/2020

Projection Robust Wasserstein Distance and Riemannian Optimization

Projection robust Wasserstein (PRW) distance, or Wasserstein projection ...
04/13/2022

Wassmap: Wasserstein Isometric Mapping for Image Manifold Learning

In this paper, we propose Wasserstein Isometric Mapping (Wassmap), a par...
06/15/2020

Penalization of barycenters for φ-exponential distributions

In this paper we study the penalization of barycenters in the Wasserstei...
04/04/2022

Revisiting Sliced Wasserstein on Images: From Vectorization to Convolution

The conventional sliced Wasserstein is defined between two probability m...
02/12/2020

Computational Hardness and Fast Algorithm for Fixed-Support Wasserstein Barycenter

We study in this paper the fixed-support Wasserstein barycenter problem ...