Log In Sign Up

Elastic Net based Feature Ranking and Selection

by   Shaode Yu, et al.

Feature selection is important in data representation and intelligent diagnosis. Elastic net is one of the most widely used feature selectors. However, the features selected are dependant on the training data, and their weights dedicated for regularized regression are irrelevant to their importance if used for feature ranking, that degrades the model interpretability and extension. In this study, an intuitive idea is put at the end of multiple times of data splitting and elastic net based feature selection. It concerns the frequency of selected features and uses the frequency as an indicator of feature importance. After features are sorted according to their frequency, linear support vector machine performs the classification in an incremental manner. At last, a compact subset of discriminative features is selected by comparing the prediction performance. Experimental results on breast cancer data sets (BCDR-F03, WDBC, GSE 10810, and GSE 15852) suggest that the proposed framework achieves competitive or superior performance to elastic net and with consistent selection of fewer features. How to further enhance its consistency on high-dimension small-sample-size data sets should be paid more attention in our future work. The proposed framework is accessible online (


page 1

page 2

page 3

page 4


Feature selection algorithm based on Catastrophe model to improve the performance of regression analysis

In this paper we introduce a new feature selection algorithm to remove t...

RENT – Repeated Elastic Net Technique for Feature Selection

In this study we present the RENT feature selection method for binary cl...

Adaptive group-regularized logistic elastic net regression

In high-dimensional data settings, additional information on the feature...

Elastic-Net Regularization in Learning Theory

Within the framework of statistical learning theory we analyze in detail...

Is feature selection secure against training data poisoning?

Learning in adversarial settings is becoming an important task for appli...

Subsampling Winner Algorithm for Feature Selection in Large Regression Data

Feature selection from a large number of covariates (aka features) in a ...

A Learning Theory Approach to a Computationally Efficient Parameter Selection for the Elastic Net

Despite recent advances in regularisation theory, the issue of parameter...