Feature Selection Using Batch-Wise Attenuation and Feature Mask Normalization

10/26/2020
by   Yiwen Liao, et al.
9

Feature selection is generally used as one of the most important pre-processing techniques in machine learning, as it helps to reduce the dimensionality of data and assists researchers and practitioners in understanding data. Thereby, better performance and reduced computational consumption, memory complexity and even data amount can be expected by utilizing feature selection. However, only few studies leverage the power of deep neural networks to solve the problem of feature selection. In this paper, we propose a feature mask module (FM-module) for feature selection based on a novel batch-wise attenuation and feature mask normalization. The proposed method is almost free from hyperparameters and can be easily integrated into common neural networks as an embedded feature selection method. Experiments on popular image, text and speech datasets have been shown that our approach is easy to use and has superior performance in comparison with other state-of-the-art deep learning based feature selection methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 13

page 14

12/11/2020

Feature Selection Based on Sparse Neural Network Layer with Normalizing Constraints

Feature selection is important step in machine learning since it has sho...
12/06/2017

Sparsity Regularization and feature selection in large dimensional data

Feature selection has evolved to be an important step in several machine...
01/17/2020

Methodology for Efficient CNN Architectures in Profiling Attacks

The side-channel community recently investigated a new approach, based o...
12/11/2017

Feature Extraction and Feature Selection: Reducing Data Complexity with Apache Spark

Feature extraction and feature selection are the first tasks in pre-proc...
02/04/2018

Heuristic Feature Selection for Clickbait Detection

We study feature selection as a means to optimize the baseline clickbait...
12/21/2018

Feature-Wise Bias Amplification

We study the phenomenon of bias amplification in classifiers, wherein a ...
12/15/2020

SPOC learner's final grade prediction based on a novel sampling batch normalization embedded neural network method

Recent years have witnessed the rapid growth of Small Private Online Cou...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.