Robust Inference for High-Dimensional Linear Models via Residual Randomization

06/14/2021
by   Y. Samuel Wang, et al.
0

We propose a residual randomization procedure designed for robust Lasso-based inference in the high-dimensional setting. Compared to earlier work that focuses on sub-Gaussian errors, the proposed procedure is designed to work robustly in settings that also include heavy-tailed covariates and errors. Moreover, our procedure can be valid under clustered errors, which is important in practice, but has been largely overlooked by earlier work. Through extensive simulations, we illustrate our method's wider range of applicability as suggested by theory. In particular, we show that our method outperforms state-of-art methods in challenging, yet more realistic, settings where the distribution of covariates is heavy-tailed or the sample size is small, while it remains competitive in standard, “well behaved" settings previously studied in the literature.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/29/2022

Residual Permutation Test for High-Dimensional Regression Coefficient Testing

We consider the problem of testing whether a single coefficient is equal...
research
09/02/2023

Robust estimation for number of factors in high dimensional factor modeling via Spearman correlation matrix

Determining the number of factors in high-dimensional factor modeling is...
research
04/18/2019

Adaptive Huber Regression on Markov-dependent Data

High-dimensional linear regression has been intensively studied in the c...
research
08/12/2019

Life After Bootstrap: Residual Randomization Inference in Regression Models

We develop a randomization-based method for inference in regression mode...
research
08/25/2020

Regularization Methods Based on the L_q-Likelihood for Linear Models with Heavy-Tailed Errors

We propose regularization methods for linear models based on the L_q-lik...
research
03/20/2019

Behavior of Lasso and Lasso-based inference under limited variability

We study the nonasymptotic behavior of Lasso and Lasso-based inference w...
research
11/16/2018

The Full Spectrum of Deep Net Hessians At Scale: Dynamics with Sample Size

Previous works observed the spectrum of the Hessian of the training loss...

Please sign up or login with your details

Forgot password? Click here to reset