Sparse Quadratic Discriminant Analysis and Community Bayes

07/17/2014
by   Ya Le, et al.
0

We develop a class of rules spanning the range between quadratic discriminant analysis and naive Bayes, through a path of sparse graphical models. A group lasso penalty is used to introduce shrinkage and encourage a similar pattern of sparsity across precision matrices. It gives sparse estimates of interactions and produces interpretable models. Inspired by the connected-components structure of the estimated precision matrices, we propose the community Bayes model, which partitions features into several conditional independent communities and splits the classification problem into separate smaller ones. The community Bayes idea is quite general and can be applied to non-Gaussian data and likelihood-based classifiers.

READ FULL TEXT
research
11/13/2017

Sparse quadratic classification rules via linear dimension reduction

We consider the problem of high-dimensional classification between the t...
research
10/01/2015

QUDA: A Direct Approach for Sparse Quadratic Discriminant Analysis

Quadratic discriminant analysis (QDA) is a standard tool for classificat...
research
04/09/2019

Sparse Laplacian Shrinkage with the Graphical Lasso Estimator for Regression Problems

This paper considers a high-dimensional linear regression problem where ...
research
06/02/2023

Hierarchical Quadratic Random Forest Classifier

In this paper, we proposed a hierarchical quadratic random forest classi...
research
12/11/2020

Sparse Functional Linear Discriminant Analysis

Functional linear discriminant analysis offers a simple yet efficient me...
research
02/13/2018

A Dimension-Independent discriminant between distributions

Henze-Penrose divergence is a non-parametric divergence measure that can...
research
03/16/2015

High-dimensional quadratic classifiers in non-sparse settings

We consider high-dimensional quadratic classifiers in non-sparse setting...

Please sign up or login with your details

Forgot password? Click here to reset