Measure Estimation in the Barycentric Coding Model

01/28/2022
by   Matthew Werenski, et al.
0

This paper considers the problem of measure estimation under the barycentric coding model (BCM), in which an unknown measure is assumed to belong to the set of Wasserstein-2 barycenters of a finite set of known measures. Estimating a measure under this model is equivalent to estimating the unknown barycenteric coordinates. We provide novel geometrical, statistical, and computational insights for measure estimation under the BCM, consisting of three main results. Our first main result leverages the Riemannian geometry of Wasserstein-2 space to provide a procedure for recovering the barycentric coordinates as the solution to a quadratic optimization problem assuming access to the true reference measures. The essential geometric insight is that the parameters of this quadratic problem are determined by inner products between the optimal displacement maps from the given measure to the reference measures defining the BCM. Our second main result then establishes an algorithm for solving for the coordinates in the BCM when all the measures are observed empirically via i.i.d. samples. We prove precise rates of convergence for this algorithm – determined by the smoothness of the underlying measures and their dimensionality – thereby guaranteeing its statistical consistency. Finally, we demonstrate the utility of the BCM and associated estimation procedures in three application areas: (i) covariance estimation for Gaussian measures; (ii) image processing; and (iii) natural language processing.

READ FULL TEXT

page 3

page 12

research
02/05/2019

Estimation of smooth densities in Wasserstein distance

The Wasserstein distances are a set of metrics on probability distributi...
research
01/18/2021

Wasserstein Convergence Rate for Empirical Measures of Markov Chains

We consider a Markov chain on ℝ^d with invariant measure μ. We are inter...
research
02/17/2020

Estimating processes in adapted Wasserstein distance

A number of researchers have independently introduced topologies on the ...
research
07/03/2019

Bounding quantiles of Wasserstein distance between true and empirical measure

Consider the empirical measure, P̂_N, associated to N i.i.d. samples of ...
research
02/02/2021

Continuous Wasserstein-2 Barycenter Estimation without Minimax Optimization

Wasserstein barycenters provide a geometric notion of the weighted avera...
research
05/06/2021

A Unifying and Canonical Description of Measure-Preserving Diffusions

A complete recipe of measure-preserving diffusions in Euclidean space wa...
research
09/18/2021

Optimization-based Block Coordinate Gradient Coding

Existing gradient coding schemes introduce identical redundancy across t...

Please sign up or login with your details

Forgot password? Click here to reset