Feature selection in high-dimensional dataset using MapReduce

09/07/2017

∙

This paper describes a distributed MapReduce implementation of the minimum Redundancy Maximum Relevance algorithm, a popular feature selection method in bioinformatics and network inference problems. The proposed approach handles both tall/narrow and wide/short datasets. We further provide an open source implementation based on Hadoop/Spark, and illustrate its scalability on datasets involving millions of observations or features.

READ FULL TEXT

Feature selection in high-dimensional dataset using MapReduce

Maximum Relevance and Minimum Redundancy Feature Selection Methods for a Marketing Machine Learning Platform

An Information Theoretic Feature Selection Framework for Big Data under Apache Spark

Scalable mRMR feature selection to handle high dimensional datasets: Vertical partitioning based Iterative MapReduce framework

An Advantage Using Feature Selection with a Quantum Annealer

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

On the utility of power spectral techniques with feature selection techniques for effective mental task classification in noninvasive BCI

DimReduction - Interactive Graphic Environment for Dimensionality Reduction

Feature selection in high-dimensional dataset using MapReduce

Related Research

Maximum Relevance and Minimum Redundancy Feature Selection Methods for a Marketing Machine Learning Platform

An Information Theoretic Feature Selection Framework for Big Data under Apache Spark

Scalable mRMR feature selection to handle high dimensional datasets: Vertical partitioning based Iterative MapReduce framework

An Advantage Using Feature Selection with a Quantum Annealer

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

On the utility of power spectral techniques with feature selection techniques for effective mental task classification in noninvasive BCI

DimReduction - Interactive Graphic Environment for Dimensionality Reduction