Exact Generalization Guarantees for (Regularized) Wasserstein Distributionally Robust Models

05/26/2023
by   Waïss Azizian, et al.
0

Wasserstein distributionally robust estimators have emerged as powerful models for prediction and decision-making under uncertainty. These estimators provide attractive generalization guarantees: the robust objective obtained from the training distribution is an exact upper bound on the true risk with high probability. However, existing guarantees either suffer from the curse of dimensionality, are restricted to specific settings, or lead to spurious error terms. In this paper, we show that these generalization guarantees actually hold on general classes of models, do not suffer from the curse of dimensionality, and can even cover distribution shifts at testing. We also prove that these results carry over to the newly-introduced regularized versions of Wasserstein distributionally robust problems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/12/2022

On Generalization and Regularization via Wasserstein Distributionally Robust Optimization

Wasserstein distributionally robust optimization (DRO) has found success...
research
06/04/2019

Confidence Regions in Wasserstein Distributionally Robust Estimation

Wasserstein distributionally robust optimization (DRO) estimators are ob...
research
06/27/2022

The Performance of Wasserstein Distributionally Robust M-Estimators in High Dimensions

Wasserstein distributionally robust optimization has recently emerged as...
research
09/09/2020

Finite-Sample Guarantees for Wasserstein Distributionally Robust Optimization: Breaking the Curse of Dimensionality

Wasserstein distributionally robust optimization (DRO) aims to find robu...
research
10/09/2017

Maximum Regularized Likelihood Estimators: A General Prediction Theory and Applications

Maximum regularized likelihood estimators (MRLEs) are arguably the most ...
research
07/25/2023

Computational Guarantees for Doubly Entropic Wasserstein Barycenters via Damped Sinkhorn Iterations

We study the computation of doubly regularized Wasserstein barycenters, ...
research
09/04/2021

Barycenteric distribution alignment and manifold-restricted invertibility for domain generalization

For the Domain Generalization (DG) problem where the hypotheses are comp...

Please sign up or login with your details

Forgot password? Click here to reset