A note on selection stability: combining stability and prediction

01/30/2013
by   Yixin Fang, et al.
0

Recently, many regularized procedures have been proposed for variable selection in linear regression, but their performance depends on the tuning parameter selection. Here a criterion for the tuning parameter selection is proposed, which combines the strength of both stability selection and cross-validation and therefore is referred as the prediction and stability selection (PASS). The selection consistency is established assuming the data generating model is a subset of the full model, and the small sample performance is demonstrated through some simulation studies where the assumption is either held or violated.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2012

Consistent selection of tuning parameters via variable selection stability

Penalized regression models are popularly used in high-dimensional data ...
research
11/05/2010

The Loss Rank Criterion for Variable Selection in Linear Regression Analysis

Lasso and other regularization procedures are attractive methods for var...
research
12/13/2017

Stability Selection for Structured Variable Selection

In variable or graph selection problems, finding a right-sized model or ...
research
07/08/2021

Parameter Selection: Why We Should Pay More Attention to It

The importance of parameter selection in supervised learning is well kno...
research
01/19/2019

Tuning parameter selection rules for nuclear norm regularized multivariate linear regression

We consider the tuning parameter selection rules for nuclear norm regula...
research
05/29/2019

Topological Techniques in Model Selection

The LASSO is an attractive regularisation method for linear regression t...
research
01/16/2023

Tale of two c(omplex)ities

For decades, best subset selection (BSS) has eluded statisticians mainly...

Please sign up or login with your details

Forgot password? Click here to reset