Feature Selection Based on Sparse Neural Network Layer with Normalizing Constraints

12/11/2020
by   Peter Bugata, et al.
0

Feature selection is important step in machine learning since it has shown to improve prediction accuracy while depressing the curse of dimensionality of high dimensional data. The neural networks have experienced tremendous success in solving many nonlinear learning problems. Here, we propose new neural-network based feature selection approach that introduces two constrains, the satisfying of which leads to sparse FS layer. We have performed extensive experiments on synthetic and real world data to evaluate performance of the proposed FS. In experiments we focus on the high dimension, low sample size data since those represent the main challenge for feature selection. The results confirm that proposed Feature Selection Based on Sparse Neural Network Layer with Normalizing Constraints (SNEL-FS) is able to select the important features and yields superior performance compared to other conventional FS methods.

READ FULL TEXT
research
11/25/2022

Graph Convolutional Network-based Feature Selection for High-dimensional and Low-sample Size Data

Feature selection is a powerful dimension reduction technique which sele...
research
06/21/2023

ProtoGate: Prototype-based Neural Networks with Local Feature Selection for Tabular Biomedical Data

Tabular biomedical data poses challenges in machine learning because it ...
research
01/07/2018

Graph Autoencoder-Based Unsupervised Feature Selection with Broad and Local Data Structure Preservation

Feature selection is a dimensionality reduction technique that selects a...
research
08/27/2021

LassoLayer: Nonlinear Feature Selection by Switching One-to-one Links

Along with the desire to address more complex problems, feature selectio...
research
02/12/2019

Binary Stochastic Filtering: a Solution for Supervised Feature Selection and Neural Network Shape Optimization

Binary Stochastic Filtering (BSF), the algorithm for feature selection a...
research
01/31/2022

Compactness Score: A Fast Filter Method for Unsupervised Feature Selection

For feature engineering, feature selection seems to be an important rese...
research
05/21/2023

Joint Feature and Differentiable k-NN Graph Learning using Dirichlet Energy

Feature selection (FS) plays an important role in machine learning, whic...

Please sign up or login with your details

Forgot password? Click here to reset