High-Dimensional Expected Shortfall Regression

07/05/2023
by   Shushu Zhang, et al.
0

The expected shortfall is defined as the average over the tail below (or above) a certain quantile of a probability distribution. The expected shortfall regression provides powerful tools for learning the relationship between a response variable and a set of covariates while exploring the heterogeneous effects of the covariates. In the health disparity research, for example, the lower/upper tail of the conditional distribution of a health-related outcome, given high-dimensional covariates, is often of importance. Under sparse models, we propose the lasso-penalized expected shortfall regression and establish non-asymptotic error bounds, depending explicitly on the sample size, dimension, and sparsity, for the proposed estimator. To perform statistical inference on a covariate of interest, we propose a debiased estimator and establish its asymptotic normality, from which asymptotically valid tests can be constructed. We illustrate the finite sample performance of the proposed method through numerical studies and a data application on health disparity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/17/2021

Non-Asymptotic Bounds for the ℓ_∞ Estimator in Linear Regression with Uniform Noise

The Chebyshev or ℓ_∞ estimator is an unconventional alternative to the o...
research
01/28/2020

Inference in High-Dimensional Linear Measurement Error Models

For a high-dimensional linear model with a finite number of covariates m...
research
09/07/2022

High-dimensional Inference for Generalized Linear Models with Hidden Confounding

Statistical inferences for high-dimensional regression models have been ...
research
12/31/2022

On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization

We study estimation and testing in the Poisson regression model with noi...
research
10/23/2022

Scalable estimation and inference for censored quantile regression process

Censored quantile regression (CQR) has become a valuable tool to study t...
research
07/03/2023

Expected Shortfall LASSO

We propose an ℓ_1-penalized estimator for high-dimensional models of Exp...
research
01/18/2022

Statistical Inference on Explained Variation in High-dimensional Linear Model with Dense Effects

Statistical inference on the explained variation of an outcome by a set ...

Please sign up or login with your details

Forgot password? Click here to reset