Linear and Quadratic Discriminant Analysis: Tutorial

06/01/2019
by   Benyamin Ghojogh, et al.
0

This tutorial explains Linear Discriminant Analysis (LDA) and Quadratic Discriminant Analysis (QDA) as two fundamental classification methods in statistical and probabilistic learning. We start with the optimization of decision boundary on which the posteriors are equal. Then, LDA and QDA are derived for binary and multiple classes. The estimation of parameters in LDA and QDA are also covered. Then, we explain how LDA and QDA are related to metric learning, kernel principal component analysis, Mahalanobis distance, logistic regression, Bayes optimal classifier, Gaussian naive Bayes, and likelihood ratio test. We also prove that LDA and Fisher discriminant analysis are equivalent. We finally clarify some of the theoretical concepts with simulations we provide.

READ FULL TEXT

page 10

page 11

page 12

page 13

page 14

research
08/20/2021

Quadratic Discriminant Analysis by Projection

Discriminant analysis, including linear discriminant analysis (LDA) and ...
research
06/23/2019

Nested Cavity Classifier: performance and remedy

Nested Cavity Classifier (NCC) is a classification rule that pursues par...
research
11/10/2022

Sketched Gaussian Model Linear Discriminant Analysis via the Randomized Kaczmarz Method

We present sketched linear discriminant analysis, an iterative randomize...
research
03/12/2022

Varying Coefficient Linear Discriminant Analysis for Dynamic Data

Linear discriminant analysis (LDA) is a vital classification tool in sta...
research
12/30/2016

Fuzzy Constraints Linear Discriminant Analysis

In this paper we introduce a fuzzy constraint linear discriminant analys...
research
07/21/2023

XLDA: Linear Discriminant Analysis for Scaling Continual Learning to Extreme Classification at the Edge

Streaming Linear Discriminant Analysis (LDA) while proven in Class-incre...
research
06/12/2014

Learning ELM network weights using linear discriminant analysis

We present an alternative to the pseudo-inverse method for determining t...

Please sign up or login with your details

Forgot password? Click here to reset