Elastic Net based Feature Ranking and Selection

12/30/2020
by   Shaode Yu, et al.
0

Feature selection is important in data representation and intelligent diagnosis. Elastic net is one of the most widely used feature selectors. However, the features selected are dependant on the training data, and their weights dedicated for regularized regression are irrelevant to their importance if used for feature ranking, that degrades the model interpretability and extension. In this study, an intuitive idea is put at the end of multiple times of data splitting and elastic net based feature selection. It concerns the frequency of selected features and uses the frequency as an indicator of feature importance. After features are sorted according to their frequency, linear support vector machine performs the classification in an incremental manner. At last, a compact subset of discriminative features is selected by comparing the prediction performance. Experimental results on breast cancer data sets (BCDR-F03, WDBC, GSE 10810, and GSE 15852) suggest that the proposed framework achieves competitive or superior performance to elastic net and with consistent selection of fewer features. How to further enhance its consistency on high-dimension small-sample-size data sets should be paid more attention in our future work. The proposed framework is accessible online (https://github.com/NicoYuCN/elasticnetFR).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2017

Feature selection algorithm based on Catastrophe model to improve the performance of regression analysis

In this paper we introduce a new feature selection algorithm to remove t...
research
09/27/2020

RENT – Repeated Elastic Net Technique for Feature Selection

In this study we present the RENT feature selection method for binary cl...
research
05/01/2018

Adaptive group-regularized logistic elastic net regression

In high-dimensional data settings, additional information on the feature...
research
07/22/2008

Elastic-Net Regularization in Learning Theory

Within the framework of statistical learning theory we analyze in detail...
research
04/21/2018

Is feature selection secure against training data poisoning?

Learning in adversarial settings is becoming an important task for appli...
research
09/23/2018

A Learning Theory Approach to a Computationally Efficient Parameter Selection for the Elastic Net

Despite recent advances in regularisation theory, the issue of parameter...
research
02/07/2020

Subsampling Winner Algorithm for Feature Selection in Large Regression Data

Feature selection from a large number of covariates (aka features) in a ...

Please sign up or login with your details

Forgot password? Click here to reset