Orthogonal variance decomposition based feature selection

10/22/2019
by   Firuz Kamalov, et al.
0

Existing feature selection methods fail to properly account for interactions between features when evaluating feature subsets. In this paper, we attempt to remedy this issue by using orthogonal variance decomposition to evaluate features. The orthogonality of the decomposition allows us to directly calculate the total contribution of a feature to the output variance. Thus we obtain an efficient algorithm for feature evaluation which takes into account interactions among features. Numerical experiments demonstrate that our method accurately identifies relevant features and improves the accuracy of numerical models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/13/2019

Gradient Boosted Feature Selection

A feature selection algorithm should ideally satisfy four conditions: re...
research
02/27/2020

High-Dimensional Feature Selection for Genomic Datasets

In the presence of large dimensional datasets that contain many irreleva...
research
10/09/2019

Supervised feature selection with orthogonal regression and feature weighting

Effective features can improve the performance of a model, which can thu...
research
05/19/2019

Good Feature Selection for Least Squares Pose Optimization in VO/VSLAM

This paper aims to select features that contribute most to the pose esti...
research
01/12/2020

On Feature Interactions Identified by Shapley Values of Binary Classification Games

For feature selection and related problems, we introduce the notion of c...
research
11/22/2017

Relief-Based Feature Selection: Introduction and Review

Feature selection plays a critical role in data mining, driven by increa...

Please sign up or login with your details

Forgot password? Click here to reset