DeepAI AI Chat
Log In Sign Up

High dimensional discriminant rules with shrinkage estimators of covariance matrix and mean vector

by   JaeHoan Kim, et al.
Texas A&M University
Seoul National University

Linear discriminant analysis is a typical method used in the case of large dimension and small samples. There are various types of linear discriminant analysis methods, which are based on the estimations of the covariance matrix and mean vectors. Although there are many methods for estimating the inverse matrix of covariance and the mean vectors, we consider shrinkage methods based on non-parametric approach. In the case of the precision matrix, the methods based on either the sparsity structure or the data splitting are considered. Regarding the estimation of mean vectors, nonparametric empirical Bayes (NPEB) estimator and nonparametric maximum likelihood estimation (NPMLE) methods are adopted which are also called f-modeling and g-modeling, respectively. We analyzed the performances of linear discriminant rules which are based on combined estimation strategies of the covariance matrix and mean vectors. In particular, we present a theoretical result on the performance of the NPEB method and compare that with the results from other methods in previous studies. We provide simulation studies for various structures of covariance matrices and mean vectors to evaluate the methods considered in this paper. In addition, real data examples such as gene expressions and EEG data are presented.


page 1

page 2

page 3

page 4


Optimal estimation of functionals of high-dimensional mean and covariance matrix

Motivated by portfolio allocation and linear discriminant analysis, we c...

A nonparametric empirical Bayes approach to covariance matrix estimation

We propose an empirical Bayes method to estimate high-dimensional covari...

Case based error variance corrected estimation of structural models

A new method for estimating structural equation models (SEM) is proposed...

Classification of high-dimensional data with spiked covariance matrix structure

We study the classification problem for high-dimensional data with n obs...

Regularization in High-Dimensional Regression and Classification via Random Matrix Theory

We study general singular value shrinkage estimators in high-dimensional...

Joint mean and covariance estimation with unreplicated matrix-variate data

It has been proposed that complex populations, such as those that arise ...