Deep Feature Selection Using a Novel Complementary Feature Mask

09/25/2022
by   Yiwen Liao, et al.
0

Feature selection has drawn much attention over the last decades in machine learning because it can reduce data dimensionality while maintaining the original physical meaning of features, which enables better interpretability than feature extraction. However, most existing feature selection approaches, especially deep-learning-based, often focus on the features with great importance scores only but neglect those with less importance scores during training as well as the order of important candidate features. This can be risky since some important and relevant features might be unfortunately ignored during training, leading to suboptimal solutions or misleading selections. In our work, we deal with feature selection by exploiting the features with less importance scores and propose a feature selection framework based on a novel complementary feature mask. Our method is generic and can be easily integrated into existing deep-learning-based feature selection approaches to improve their performance as well. Experiments have been conducted on benchmarking datasets and shown that the proposed method can select more representative and informative features than the state of the art.

READ FULL TEXT
research
10/26/2020

Feature Selection Using Batch-Wise Attenuation and Feature Mask Normalization

Feature selection is generally used as one of the most important pre-pro...
research
05/11/2021

Comparing interpretability and explainability for feature selection

A common approach for feature selection is to examine the variable impor...
research
10/02/2022

Ensembling improves stability and power of feature selection for deep learning models

With the growing adoption of deep learning models in different real-worl...
research
01/25/2011

Using Feature Weights to Improve Performance of Neural Networks

Different features have different relevance to a particular learning pro...
research
06/08/2020

Interpretable Signal Analysis with Knockoffs Enhances Classification of Bacterial Raman Spectra

Interpretability is important for many applications of machine learning ...
research
05/17/2022

Unsupervised Features Ranking via Coalitional Game Theory for Categorical Data

Not all real-world data are labeled, and when labels are not available, ...
research
11/30/2022

Feature Selection with Distance Correlation

Choosing which properties of the data to use as input to multivariate de...

Please sign up or login with your details

Forgot password? Click here to reset