Dimension Reduction by Mutual Information Discriminant Analysis

by   Ali Shadvar, et al.

In the past few decades, researchers have proposed many discriminant analysis (DA) algorithms for the study of high-dimensional data in a variety of problems. Most DA algorithms for feature extraction are based on transformations that simultaneously maximize the between-class scatter and minimize the withinclass scatter matrices. This paper presents a novel DA algorithm for feature extraction using mutual information (MI). However, it is not always easy to obtain an accurate estimation for high-dimensional MI. In this paper, we propose an efficient method for feature extraction that is based on one-dimensional MI estimations. We will refer to this algorithm as mutual information discriminant analysis (MIDA). The performance of this proposed method was evaluated using UCI databases. The results indicate that MIDA provides robust performance over different data sets with different characteristics and that MIDA always performs better than, or at least comparable to, the best performing algorithms.



There are no comments yet.


page 1

page 2

page 3

page 4


Dimension Reduction by Mutual Information Feature Extraction

During the past decades, to study high-dimensional data in a large varie...

Generalized Discriminant Analysis algorithm for feature reduction in Cyber Attack Detection System

This Generalized Discriminant Analysis (GDA) has provided an extremely p...

Sliced Mutual Information: A Scalable Measure of Statistical Dependence

Mutual information (MI) is a fundamental measure of statistical dependen...

Sirius: A Mutual Information Tool for Exploratory Visualization of Mixed Data

Data scientists across disciplines are increasingly in need of explorato...

Communications Inspired Linear Discriminant Analysis

We study the problem of supervised linear dimensionality reduction, taki...

Estimation of Squared-Loss Mutual Information from Positive and Unlabeled Data

Capturing input-output dependency is an important task in statistical da...

Quadratic Projection Based Feature Extraction with Its Application to Biometric Recognition

This paper presents a novel quadratic projection based feature extractio...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.