Distributional Consistency of Lasso by Perturbation Bootstrap

10/29/2017
by   Debraj Das, et al.
0

Least Absolute Shrinkage and Selection Operator or the Lasso, introduced by Tibshirani (1996), is a popular estimation procedure in multiple linear regression when underlying design has a sparse structure, because of its property that it sets some regression coefficients exactly equal to 0. In this article, we develop a perturbation bootstrap method and establish its validity in approximating the distribution of the Lasso in heteroscedastic linear regression. We allow the underlying covariates to be either random or non-random. We show that the proposed bootstrap method works irrespective of the nature of the covariates, unlike the resample-based bootstrap of Freedman (1981) which must be tailored based on the nature (random vs non-random) of the covariates. Simulation study also justifies our method in finite samples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2017

Variable Selection in Restricted Linear Regression Models

The use of prior information in the linear regression is well known to p...
research
09/14/2019

Higher Order Refinements by Bootstrap in Lasso and other Penalized Regression Methods

Selection of important covariates and to drop the unimportant ones from ...
research
11/09/2017

Debiasing the Debiased Lasso with Bootstrap

In this paper, we prove that under proper conditions, bootstrap can furt...
research
07/03/2020

On Second order correctness of Bootstrap in Logistic Regression

In the fields of clinical trials, biomedical surveys, marketing, banking...
research
06/17/2021

On the Power of Preconditioning in Sparse Linear Regression

Sparse linear regression is a fundamental problem in high-dimensional st...
research
07/05/2023

D-optimal Subsampling Design for Massive Data Linear Regression

Data reduction is a fundamental challenge of modern technology, where cl...
research
07/01/2020

Linear regression and its inference on noisy network-linked data

Linear regression on a set of observations linked by a network has been ...

Please sign up or login with your details

Forgot password? Click here to reset