Limit Distribution Theory for the Smooth 1-Wasserstein Distance with Applications

07/28/2021
by   Ritwik Sadhu, et al.
0

The smooth 1-Wasserstein distance (SWD) W_1^σ was recently proposed as a means to mitigate the curse of dimensionality in empirical approximation while preserving the Wasserstein structure. Indeed, SWD exhibits parametric convergence rates and inherits the metric and topological structure of the classic Wasserstein distance. Motivated by the above, this work conducts a thorough statistical study of the SWD, including a high-dimensional limit distribution result for empirical W_1^σ, bootstrap consistency, concentration inequalities, and Berry-Esseen type bounds. The derived nondegenerate limit stands in sharp contrast with the classic empirical W_1, for which a similar result is known only in the one-dimensional case. We also explore asymptotics and characterize the limit distribution when the smoothing parameter σ is scaled with n, converging to 0 at a sufficiently slow rate. The dimensionality of the sampled distribution enters empirical SWD convergence bounds only through the prefactor (i.e., the constant). We provide a sharp characterization of this prefactor's dependence on the smoothing parameter and the intrinsic dimension. This result is then used to derive new empirical convergence rates for classic W_1 in terms of the intrinsic dimension. As applications of the limit distribution theory, we study two-sample testing and minimum distance estimation (MDE) under W_1^σ. We establish asymptotic validity of SWD testing, while for MDE, we prove measurability, almost sure convergence, and limit distributions for optimal estimators and their corresponding W_1^σ error. Our results suggest that the SWD is well suited for high-dimensional statistical learning and inference.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2020

Limit Distribution Theory for Smooth Wasserstein Distance with Applications to Generative Modeling

The 1-Wasserstein distance (W_1) is a popular proximity measure between ...
research
03/01/2022

Limit distribution theory for smooth p-Wasserstein distances

The Wasserstein distance is a metric on a space of probability measures ...
research
01/11/2021

From Smooth Wasserstein Distance to Dual Sobolev Norm: Empirical Approximation and Statistical Applications

Statistical distances, i.e., discrepancy measures between probability di...
research
10/17/2022

Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distances

Sliced Wasserstein distances preserve properties of classic Wasserstein ...
research
02/03/2020

Limit Distribution for Smooth Total Variation and χ^2-Divergence in High Dimensions

Statistical divergences are ubiquitous in machine learning as tools for ...
research
12/17/2020

Nearly optimal central limit theorem and bootstrap approximations in high dimensions

In this paper, we derive new, nearly optimal bounds for the Gaussian app...
research
06/17/2022

k-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension

Sliced mutual information (SMI) is defined as an average of mutual infor...

Please sign up or login with your details

Forgot password? Click here to reset