High-dimensional quadratic classifiers in non-sparse settings

03/16/2015
by   Makoto Aoshima, et al.
0

We consider high-dimensional quadratic classifiers in non-sparse settings. The target of classification rules is not Bayes error rates in the context. The classifier based on the Mahalanobis distance does not always give a preferable performance even if the populations are normal distributions having known covariance matrices. The quadratic classifiers proposed in this paper draw information about heterogeneity effectively through both the differences of expanding mean vectors and covariance matrices. We show that they hold a consistency property in which misclassification rates tend to zero as the dimension goes to infinity under non-sparse settings. We verify that they are asymptotically distributed as a normal distribution under certain conditions. We also propose a quadratic classifier after feature selection by using both the differences of mean vectors and covariance matrices. Finally, we discuss performances of the classifiers in actual data analyses. The proposed classifiers achieve highly accurate classification with very low computational costs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/25/2020

High-Dimensional Quadratic Discriminant Analysis under Spiked Covariance Model

Quadratic discriminant analysis (QDA) is a widely used classification te...
research
11/13/2017

Sparse quadratic classification rules via linear dimension reduction

We consider the problem of high-dimensional classification between the t...
research
02/26/2017

Support vector machine and its bias correction in high-dimension, low-sample-size settings

In this paper, we consider asymptotic properties of the support vector m...
research
10/20/2022

CLT for random quadratic forms based on sample means and sample covariance matrices

In this paper, we use the dimensional reduction technique to study the c...
research
01/08/2020

On a Generalization of the Average Distance Classifier

In high dimension, low sample size (HDLSS)settings, the simple average d...
research
08/24/2021

Phase Transitions for High-Dimensional Quadratic Discriminant Analysis with Rare and Weak Signals

Consider a two-class classification problem where we observe samples (X_...
research
07/17/2014

Sparse Quadratic Discriminant Analysis and Community Bayes

We develop a class of rules spanning the range between quadratic discrim...

Please sign up or login with your details

Forgot password? Click here to reset