High-Dimensional Feature Selection by Feature-Wise Non-Linear Lasso

02/02/2012
by   Makoto Yamada, et al.
0

The goal of supervised feature selection is to find a subset of input features that are responsible for predicting output values. The least absolute shrinkage and selection operator (Lasso) allows computationally efficient feature selection based on linear dependency between input features and output values. In this paper, we consider a feature-wise kernelized Lasso for capturing non-linear input-output dependency. We first show that, with particular choices of kernel functions, non-redundant features with strong statistical dependence on output values can be found in terms of kernel-based independence measures. We then show that the globally optimal solution can be efficiently computed; this makes the approach scalable to high-dimensional problems. The effectiveness of the proposed method is demonstrated through feature selection experiments with thousands of features.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/10/2014

N^3LARS: Minimum Redundancy Maximum Relevance Feature Selection for Large and High-dimensional Data

We propose a feature selection method that finds non-redundant features ...
research
04/26/2022

Identification of feasible pathway information for c-di-GMP binding proteins in cellulose production

In this paper, we utilize a machine learning approach to identify the si...
research
10/29/2020

Post-selection inference with HSIC-Lasso

Detecting influential features in complex (non-linear and/or high-dimens...
research
03/22/2019

On the support recovery of marginal regression

Leading methods for support recovery in high-dimensional regression, suc...
research
03/25/2015

Stable Feature Selection from Brain sMRI

Neuroimage analysis usually involves learning thousands or even millions...
research
08/14/2016

Ultra High-Dimensional Nonlinear Feature Selection for Big Biological Data

Machine learning methods are used to discover complex nonlinear relation...
research
11/18/2016

Finding Alternate Features in Lasso

We propose a method for finding alternate features missing in the Lasso ...

Please sign up or login with your details

Forgot password? Click here to reset