Multivariate Distributionally Robust Convex Regression under Absolute Error Loss

05/29/2019
by   Jose Blanchet, et al.
0

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein perturbations of the empirical measure) of the absolute regression errors. The inner maximization is solved in closed form resulting in a regularization penalty involves the norm of the gradient. We show consistency of our estimator and a rate of convergence of order O( n^-1/d) , matching the bounds of alternative estimators based on square-loss minimization. Contrary to all of the existing results, our convergence rates hold without imposing compactness on the underlying domain and with no a priori bounds on the underlying convex function or its gradient norm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/14/2022

On the generalization error of norm penalty linear regression models

We study linear regression problems inf_β∈ℝ^d(𝔼_ℙ_n[|Y - 𝐗^⊤β|^r])^1/r +...
research
01/16/2023

Distributionally Robust Learning with Weakly Convex Losses: Convergence Rates and Finite-Sample Guarantees

We consider a distributionally robust stochastic optimization problem an...
research
03/02/2020

Smooth Strongly Convex Regression

Convex regression (CR) is the problem of fitting a convex function to a ...
research
09/27/2021

Distributionally Robust Multi-Output Regression Ranking

Despite their empirical success, most existing listwiselearning-to-rank ...
research
04/07/2019

Characterization of parameters with a mixed bias property

In this article we characterize a class of parameters in large non-param...
research
03/12/2020

Benign overfitting in the large deviation regime

We investigate the benign overfitting phenomenon in the large deviation ...
research
05/05/2014

Model Consistency of Partly Smooth Regularizers

This paper studies least-square regression penalized with partly smooth ...

Please sign up or login with your details

Forgot password? Click here to reset