Distributionally robust halfspace depth

01/03/2021
by   Jevgenijs Ivanovs, et al.
0

Tukey's halfspace depth can be seen as a stochastic program and as such it is not guarded against optimizer's curse, so that a limited training sample may easily result in a poor out-of-sample performance. We propose a generalized halfspace depth concept relying on the recent advances in distributionally robust optimization, where every halfspace is examined using the respective worst-case distribution in the Wasserstein ball of radius δ≥ 0 centered at the empirical law. This new depth can be seen as a smoothed and regularized classical halfspace depth which is retrieved as δ↓ 0. It inherits most of the main properties of the latter and, additionally, enjoys various new attractive features such as continuity and strict positivity beyond the convex hull of the support. We provide numerical illustrations of the new depth and its advantages, and develop some fundamental theory. In particular, we study the upper level sets and the median region including their breakdown properties.

READ FULL TEXT

page 22

page 28

research
09/30/2015

Distributionally Robust Logistic Regression

This paper proposes a distributionally robust approach to logistic regre...
research
07/03/2023

Quantifying Distributional Model Risk in Marginal Problems via Optimal Transport

This paper studies distributional model risk in marginal problems, where...
research
10/27/2017

Regularization via Mass Transportation

The goal of regression and classification methods in supervised learning...
research
09/30/2020

Wasserstein Distributionally Robust Inverse Multiobjective Optimization

Inverse multiobjective optimization provides a general framework for the...
research
05/31/2021

Halfspace depth for general measures: The ray basis theorem and its consequences

The halfspace depth is a prominent tool of nonparametric multivariate an...
research
03/23/2021

Depth-based pseudo-metrics between probability distributions

Data depth is a non parametric statistical tool that measures centrality...
research
05/10/2019

Illumination depth

The concept of illumination bodies studied in convex geometry is used to...

Please sign up or login with your details

Forgot password? Click here to reset