Deep-gKnock: nonlinear group-feature selection with deep neural network

05/24/2019
by   Guangyu Zhu, et al.
0

Feature selection is central to contemporary high-dimensional data analysis. Grouping structure among features arises naturally in various scientific problems. Many methods have been proposed to incorporate the grouping structure information into feature selection. However, these methods are normally restricted to a linear regression setting. To relax the linear constraint, we combine the deep neural networks (DNNs) with the recent Knockoffs technique, which has been successful in an individual feature selection context. We propose Deep-gKnock (Deep group-feature selection using Knockoffs) as a methodology for model interpretation and dimension reduction. Deep-gKnock performs model-free group-feature selection by controlling group-wise False Discovery Rate (gFDR). Our method improves the interpretability and reproducibility of DNNs. Experimental results on both synthetic and real data demonstrate that our method achieves superior power and accurate gFDR control compared with state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2018

DeepPINK: reproducible feature selection in deep neural networks

Deep learning has become increasingly popular in both supervised and uns...
research
03/17/2019

Deep Feature Selection using a Teacher-Student Network

High-dimensional data in many machine learning applications leads to com...
research
08/01/2023

Copula for Instance-wise Feature Selection and Ranking

Instance-wise feature selection and ranking methods can achieve a good s...
research
10/13/2020

Neural Gaussian Mirror for Controlled Feature Selection in Neural Networks

Deep neural networks (DNNs) have become increasingly popular and achieve...
research
09/15/2022

Feature Selection integrated Deep Learning for Ultrahigh Dimensional and Highly Correlated Feature Space

In recent years, deep learning has been a topic of interest in almost al...
research
07/06/2022

Deep Partial Least Squares for IV Regression

In this paper, we propose deep partial least squares for the estimation ...
research
08/21/2016

Online Feature Selection with Group Structure Analysis

Online selection of dynamic features has attracted intensive interest in...

Please sign up or login with your details

Forgot password? Click here to reset