The Loss Rank Criterion for Variable Selection in Linear Regression Analysis

11/05/2010
by   Minh-Ngoc Tran, et al.
0

Lasso and other regularization procedures are attractive methods for variable selection, subject to a proper choice of shrinkage parameter. Given a set of potential subsets produced by a regularization algorithm, a consistent model selection criterion is proposed to select the best one among this preselected set. The approach leads to a fast and efficient procedure for variable selection, especially in high-dimensional settings. Model selection consistency of the suggested criterion is proven when the number of covariates d is fixed. Simulation studies suggest that the criterion still enjoys model selection consistency when d is much larger than the sample size. The simulations also show that our approach for variable selection works surprisingly well in comparison with existing competitors. The method is also applied to a real data set.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2021

The EAS approach to variable selection for multivariate response data in high-dimensional settings

In this paper, we extend the epsilon admissible subsets (EAS) model sele...
research
04/08/2008

Bolasso: model consistent Lasso estimation through the bootstrap

We consider the least-square linear regression problem with regularizati...
research
07/09/2022

A Statistically-Based Approach to Feedforward Neural Network Model Selection

Feedforward neural networks (FNNs) can be viewed as non-linear regressio...
research
05/29/2019

Topological Techniques in Model Selection

The LASSO is an attractive regularisation method for linear regression t...
research
09/24/2021

A comprehensive review of variable selection in high-dimensional regression for molecular biology

Variable selection methods are widely used in molecular biology to detec...
research
01/30/2013

A note on selection stability: combining stability and prediction

Recently, many regularized procedures have been proposed for variable se...
research
02/23/2023

Variable selection in linear regression models: choosing the best subset is not always the best choice

Variable selection in linear regression settings is a much discussed pro...

Please sign up or login with your details

Forgot password? Click here to reset