Deep Feature Screening: Feature Selection for Ultra High-Dimensional Data via Deep Neural Networks

04/04/2022
by   Kexuan Li, et al.
1

The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and strong model assumption. In this paper, we propose a novel two-step nonparametric approach called Deep Feature Screening (DeepFS) that can overcome these problems and identify significant features with high precision for ultra high-dimensional, low-sample-size data. This approach first extracts a low-dimensional representation of input data and then applies feature screening based on multivariate rank distance correlation recently developed by Deb and Sen (2021). This approach combines the strengths of both deep neural networks and feature screening, and thereby has the following appealing features in addition to its ability of handling ultra high-dimensional data with small number of samples: (1) it is model free and distribution free; (2) it can be used for both supervised and unsupervised feature selection; and (3) it is capable of recovering the original input data. The superiority of DeepFS is demonstrated via extensive simulation studies and real data analyses.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2023

A model-free feature selection technique of feature screening and random forest based recursive feature elimination

In this paper, we propose a model-free feature selection method for ultr...
research
04/07/2021

Online Feature Screening for Data Streams with Concept Drift

Screening feature selection methods are often used as a preprocessing st...
research
02/24/2015

On the consistency theory of high dimensional variable screening

Variable screening is a fast dimension reduction technique for assisting...
research
07/01/2023

Sparse-Input Neural Network using Group Concave Regularization

Simultaneous feature selection and non-linear function estimation are ch...
research
11/04/2016

Classification with Ultrahigh-Dimensional Features

Although much progress has been made in classification with high-dimensi...
research
03/25/2014

Selective Factor Extraction in High Dimensions

This paper studies simultaneous feature selection and extraction in supe...
research
06/21/2022

BiometricBlender: Ultra-high dimensional, multi-class synthetic data generator to imitate biometric feature space

The lack of freely available (real-life or synthetic) high or ultra-high...

Please sign up or login with your details

Forgot password? Click here to reset