MDFS - MultiDimensional Feature Selection

10/31/2018
by   Radosław Piliszek, et al.
0

Identification of informative variables in an information system is often performed using simple one-dimensional filtering procedures that discard information about interactions between variables. Such approach may result in removing some relevant variables from consideration. Here we present an R package MDFS (MultiDimensional Feature Selection) that performs identification of informative variables taking into account synergistic interactions between multiple descriptors and the decision variable. MDFS is an implementation of an algorithm based on information theory. Computational kernel of the package is implemented in C++. A high-performance version implemented in CUDA C is also available. The applications of MDFS are demonstrated using the well-known Madelon dataset that has synergistic variables by design. The dataset comes from the UCI Machine Learning Repository. It is shown that multidimensional analysis is more sensitive than one-dimensional tests and returns more reliable rankings of importance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2017

All-relevant feature selection using multidimensional filters with exhaustive search

This paper describes a method for identification of the informative vari...
research
02/24/2020

FSinR: an exhaustive package for feature selection

Feature Selection (FS) is a key task in Machine Learning. It consists in...
research
11/20/2018

Contingency Training

When applied to high-dimensional datasets, feature selection algorithms ...
research
06/01/2020

A Combined Approach To Detect Key Variables In Thick Data Analytics

In machine learning one of the strategic tasks is the selection of only ...
research
06/16/2022

Powershap: A Power-full Shapley Feature Selection Method

Feature selection is a crucial step in developing robust and powerful ma...
research
11/10/2017

Lurking Variable Detection via Dimensional Analysis

Lurking variables represent hidden information, and preclude a full unde...

Please sign up or login with your details

Forgot password? Click here to reset