Sinkhorn Distributionally Robust Optimization

09/24/2021
by   Jie Wang, et al.
0

We study distributionally robust optimization with Sinkorn distance – a variant of Wasserstein distance based on entropic regularization. We derive convex programming dual reformulations when the nominal distribution is an empirical distribution and a general distribution, respectively. Compared with Wasserstein DRO, it is computationally tractable for a larger class of loss functions, and its worst-case distribution is more reasonable. To solve the dual reformulation, we propose an efficient batch gradient descent with a bisection search algorithm. Finally, we provide various numerical examples using both synthetic and real data to demonstrate its competitive performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/27/2022

The Performance of Wasserstein Distributionally Robust M-Estimators in High Dimensions

Wasserstein distributionally robust optimization has recently emerged as...
research
01/29/2020

Regularization Helps with Mitigating Poisoning Attacks: Distributionally-Robust Machine Learning Using the Wasserstein Distance

We use distributionally-robust optimization for machine learning to miti...
research
05/29/2021

Robust Hypothesis Testing with Wasserstein Uncertainty Sets

We consider a data-driven robust hypothesis test where the optimal test ...
research
12/17/2017

Wasserstein Distributional Robustness and Regularization in Statistical Learning

A central question in statistical learning is to design algorithms that ...
research
07/18/2020

A Distributionally Robust Approach to Fair Classification

We propose a distributionally robust logistic regression model with an u...
research
10/24/2020

Fast Epigraphical Projection-based Incremental Algorithms for Wasserstein Distributionally Robust Support Vector Machine

Wasserstein Distributionally Robust Optimization (DRO) is concerned with...
research
06/05/2020

Principled Learning Method for Wasserstein Distributionally Robust Optimization with Local Perturbations

Wasserstein distributionally robust optimization (WDRO) attempts to lear...

Please sign up or login with your details

Forgot password? Click here to reset