A penalized likelihood method for classification with matrix-valued predictors

09/23/2016
by   Aaron J. Molstad, et al.
0

We propose a penalized likelihood method to fit the linear discriminant analysis model when the predictor is matrix valued. We simultaneously estimate the means and the precision matrix, which we assume has a Kronecker product decomposition. Our penalties encourage pairs of response category mean matrices to have equal entries and also encourage zeros in the precision matrix. To compute our estimators, we use a blockwise coordinate descent algorithm. To update the optimization variables corresponding to response category mean matrices, we use an alternating minimization algorithm that takes advantage of the Kronecker structure of the precision matrix. We show that our method can outperform relevant competitors in classification, even when our modeling assumptions are violated. We analyze an EEG dataset to demonstrate our method's interpretability and classification accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/01/2020

Estimating Multiple Precision Matrices with Cluster Fusion Regularization

We propose a penalized likelihood framework for estimating multiple prec...
research
05/10/2017

Automatic Response Category Combination in Multinomial Logistic Regression

We propose a penalized likelihood method that simultaneously fits the mu...
research
12/01/2019

Penalized Matrix Regression for Two-Dimensional Variable Selection

The root-cause diagnostics for product quality defects in multistage man...
research
11/07/2011

Discriminant Analysis with Adaptively Pooled Covariance

Linear and Quadratic Discriminant analysis (LDA/QDA) are common tools fo...
research
04/07/2019

Precision Matrix Estimation with Noisy and Missing Data

Estimating conditional dependence graphs and precision matrices are some...
research
03/07/2022

Matrix Decomposition Perspective for Accuracy Assessment of Item Response Theory

The item response theory obtains the estimates and their confidence inte...
research
08/31/2018

An explicit mean-covariance parameterization for multivariate response linear regression

We develop a new method to fit the multivariate response linear regressi...

Please sign up or login with your details

Forgot password? Click here to reset