Quantized Fisher Discriminant Analysis

09/06/2019
by   Benyamin Ghojogh, et al.
0

This paper proposes a new subspace learning method, named Quantized Fisher Discriminant Analysis (QFDA), which makes use of both machine learning and information theory. There is a lack of literature for combination of machine learning and information theory and this paper tries to tackle this gap. QFDA finds a subspace which discriminates the uniformly quantized images in the Discrete Cosine Transform (DCT) domain at least as well as discrimination of non-quantized images by Fisher Discriminant Analysis (FDA) while the images have been compressed. This helps the user to throw away the original images and keep the compressed images instead without noticeable loss of classification accuracy. We propose a cost function whose minimization can be interpreted as rate-distortion optimization in information theory. We also propose quantized Fisherfaces for facial analysis in QFDA. Our experiments on AT T face dataset and Fashion MNIST dataset show the effectiveness of this subspace learning method.

READ FULL TEXT

page 6

page 7

research
04/04/2020

Weighted Fisher Discriminant Analysis in the Input and Feature Spaces

Fisher Discriminant Analysis (FDA) is a subspace learning method which m...
research
04/05/2020

Fisher Discriminant Triplet and Contrastive Losses for Training Siamese Networks

Siamese neural network is a very powerful architecture for both feature ...
research
10/11/2019

Roweis Discriminant Analysis: A Generalized Subspace Learning Method

We present a new method which generalizes subspace learning based on eig...
research
09/09/2023

Fisher's Pioneering work on Discriminant Analysis and its Impact on AI

Fisher opened many new areas in Multivariate Analysis, and the one which...
research
06/22/2019

Fisher and Kernel Fisher Discriminant Analysis: Tutorial

This is a detailed tutorial paper which explains the Fisher discriminant...
research
09/01/2020

Graph Embedding with Data Uncertainty

spectral-based subspace learning is a common data preprocessing step in ...
research
10/07/2018

Recovering Quantized Data with Missing Information Using Bilinear Factorization and Augmented Lagrangian Method

In this paper, we propose a novel approach in order to recover a quantiz...

Please sign up or login with your details

Forgot password? Click here to reset