Feature Selection Using Batch-Wise Attenuation and Feature Mask Normalization

by   Yiwen Liao, et al.

Feature selection is generally used as one of the most important pre-processing techniques in machine learning, as it helps to reduce the dimensionality of data and assists researchers and practitioners in understanding data. Thereby, better performance and reduced computational consumption, memory complexity and even data amount can be expected by utilizing feature selection. However, only few studies leverage the power of deep neural networks to solve the problem of feature selection. In this paper, we propose a feature mask module (FM-module) for feature selection based on a novel batch-wise attenuation and feature mask normalization. The proposed method is almost free from hyperparameters and can be easily integrated into common neural networks as an embedded feature selection method. Experiments on popular image, text and speech datasets have been shown that our approach is easy to use and has superior performance in comparison with other state-of-the-art deep learning based feature selection methods.



There are no comments yet.


page 3

page 13

page 14


Feature Selection Based on Sparse Neural Network Layer with Normalizing Constraints

Feature selection is important step in machine learning since it has sho...

Sparsity Regularization and feature selection in large dimensional data

Feature selection has evolved to be an important step in several machine...

Methodology for Efficient CNN Architectures in Profiling Attacks

The side-channel community recently investigated a new approach, based o...

Feature Extraction and Feature Selection: Reducing Data Complexity with Apache Spark

Feature extraction and feature selection are the first tasks in pre-proc...

Heuristic Feature Selection for Clickbait Detection

We study feature selection as a means to optimize the baseline clickbait...

Feature-Wise Bias Amplification

We study the phenomenon of bias amplification in classifiers, wherein a ...

SPOC learner's final grade prediction based on a novel sampling batch normalization embedded neural network method

Recent years have witnessed the rapid growth of Small Private Online Cou...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.