Quantile universal threshold: model selection at the detection edge for high-dimensional linear regression

12/05/2014
by   Jairo Diaz-Rodriguez, et al.
0

To estimate a sparse linear model from data with Gaussian noise, consilience from lasso and compressed sensing literatures is that thresholding estimators like lasso and the Dantzig selector have the ability in some situations to identify with high probability part of the significant covariates asymptotically, and are numerically tractable thanks to convexity. Yet, the selection of a threshold parameter λ remains crucial in practice. To that aim we propose Quantile Universal Thresholding, a selection of λ at the detection edge. We show with extensive simulations and real data that an excellent compromise between high true positive rate and low false discovery rate is achieved, leading also to good predictive risk.

READ FULL TEXT

page 10

page 11

page 16

research
05/14/2018

Model selection with lasso-zero: adding straw to the haystack to better find needles

The high-dimensional linear model y = X β^0 + ϵ is considered and the fo...
research
02/03/2023

Trade-off between prediction and FDR for high-dimensional Gaussian model selection

In the context of the high-dimensional Gaussian linear regression for or...
research
01/30/2023

Convergence of uncertainty estimates in Ensemble and Bayesian sparse model discovery

Sparse model identification enables nonlinear dynamical system discovery...
research
12/10/2020

A Convex Programming Solution Based Debiased Estimator for Quantile with Missing Response and High-dimensional Covariables

This paper is concerned with the estimating problem of response quantile...
research
07/29/2014

Sure Screening for Gaussian Graphical Models

We propose graphical sure screening, or GRASS, a very simple and computa...
research
01/24/2020

Imputation for High-Dimensional Linear Regression

We study high-dimensional regression with missing entries in the covaria...
research
10/17/2020

On the best choice of Lasso program given data parameters

Generalized compressed sensing (GCS) is a paradigm in which a structured...

Please sign up or login with your details

Forgot password? Click here to reset