Parallel Streaming Wasserstein Barycenters

by   Matthew Staib, et al.

Efficiently aggregating data from different sources is a challenging problem, particularly when samples from each source are distributed differently. These differences can be inherent to the inference task or present for other reasons: sensors in a sensor network may be placed far apart, affecting their individual measurements. Conversely, it is computationally advantageous to split Bayesian inference tasks across subsets of data, but data need not be identically distributed across subsets. One principled way to fuse probability distributions is via the lens of optimal transport: the Wasserstein barycenter is a single distribution that summarizes a collection of input measures while respecting their geometry. However, computing the barycenter scales poorly and requires discretization of all input distributions and the barycenter itself. Improving on this situation, we present a scalable, communication-efficient, parallel algorithm for computing the Wasserstein barycenter of arbitrary distributions. Our algorithm can operate directly on continuous input distributions and is optimized for streaming data. Our method is even robust to nonstationary input distributions and produces a barycenter estimate that tracks the input measures over time. The algorithm is semi-discrete, needing to discretize only the barycenter estimate. To the best of our knowledge, we also provide the first bounds on the quality of the approximate barycenter as the discretization becomes finer. Finally, we demonstrate the practical effectiveness of our method, both in tracking moving distributions on a sphere, as well as in a large-scale Bayesian inference task.


page 1

page 2

page 3

page 4


Scalable Computations of Wasserstein Barycenter via Input Convex Neural Networks

Wasserstein Barycenter is a principled approach to represent the weighte...

Streaming computation of optimal weak transport barycenters

We introduce the weak barycenter of a family of probability distribution...

Variational Wasserstein Barycenters with c-Cyclical Monotonicity

Wasserstein barycenter, built on the theory of optimal transport, provid...

On the Wasserstein median of probability measures

Measures of central tendency such as mean and median are a primary way t...

Stochastic Wasserstein Barycenters

We present a stochastic algorithm to compute the barycenter of a set of ...

GeONet: a neural operator for learning the Wasserstein geodesic

Optimal transport (OT) offers a versatile framework to compare complex d...

Continuous Wasserstein-2 Barycenter Estimation without Minimax Optimization

Wasserstein barycenters provide a geometric notion of the weighted avera...

Please sign up or login with your details

Forgot password? Click here to reset