Omitted variable bias of Lasso-based inference methods under limited variability: A finite sample analysis

03/20/2019
∙
by   Kaspar Wuthrich, et al.
∙
0
∙

We study the finite sample behavior of Lasso and Lasso-based inference methods when the covariates exhibit limited variability. In settings that are generally considered favorable to Lasso, we prove that, with high probability, limited variability can render Lasso unable to select even those covariates with coefficients that are well-separated from zero. We also show that post double Lasso and debiased Lasso can exhibit substantial omitted variable biases under limited variability. Monte Carlo simulations corroborate our theoretical results and further demonstrate that, under limited variability, the performance of Lasso and Lasso-based inference methods is very sensitive to the choice of penalty parameters. In moderately high-dimensional problems, where the number of covariates is comparable to but smaller than the sample size, OLS constitutes a natural alternative to Lasso-based inference methods. In empirically relevant settings, our simulation results show that OLS is superior to Lasso-based inference methods under limited variability.

READ FULL TEXT

Please sign up or login with your details

Continue with:
Or login with email
Enter Password
Re-enter Password

Forgot password? Click here to reset
Success!
Error Icon An error occurred

Sign in with Google

×

Use your Google Account to sign in to DeepAI

×
Pro

Consider DeepAI Pro

Subscribe to DeepAI Pro
DeepAI Pro
Provides a limited generation allowance each month. When exceeded, you are charged overage rates available at deepai.org/pricing. Also includes an ad-free experience and API access. Renews automatically until canceled. Non-refundable.
Subtotal
Total due today

Payment

Add DeepAI credits
DeepAI credits
One-time purchase. Credits are added to your wallet after payment.
Subtotal
Total due today

Payment