Adjusted Measures for Feature Selection Stability for Data Sets with Similar Features

09/25/2020
by   Andrea Bommert, et al.
0

For data sets with similar features, for example highly correlated features, most existing stability measures behave in an undesired way: They consider features that are almost identical but have different identifiers as different features. Existing adjusted stability measures, that is, stability measures that take into account the similarities between features, have major theoretical drawbacks. We introduce new adjusted stability measures that overcome these drawbacks. We compare them to each other and to existing stability measures based on both artificial and real sets of selected features. Based on the results, we suggest using one new stability measure that considers highly similar features as exchangeable.

READ FULL TEXT

page 9

page 10

research
06/15/2021

Employing an Adjusted Stability Measure for Multi-Criteria Model Fitting on Data Sets with Similar Features

Fitting models with high predictive accuracy that include all relevant b...
research
01/03/2022

Cluster Stability Selection

Stability selection (Meinshausen and Buhlmann, 2010) makes any feature s...
research
11/30/2020

Utilizing stability criteria in choosing feature selection methods yields reproducible results in microbiome data

Feature selection is indispensable in microbiome data analysis, but it c...
research
10/31/2016

A New Distance Measure for Non-Identical Data with Application to Image Classification

Distance measures are part and parcel of many computer vision algorithms...
research
05/26/2020

The best way to select features?

Feature selection in machine learning is subject to the intrinsic random...
research
06/02/2020

Interpretable Meta-Measure for Model Performance

Measures for evaluation of model performance play an important role in M...
research
08/08/2021

A Look at the Evaluation Setup of the M5 Forecasting Competition

Forecast evaluation plays a key role in how empirical evidence shapes th...

Please sign up or login with your details

Forgot password? Click here to reset