An Empirical Bayes Approach for High Dimensional Classification

02/16/2017
by   Yunbo Ouyang, et al.
0

We propose an empirical Bayes estimator based on Dirichlet process mixture model for estimating the sparse normalized mean difference, which could be directly applied to the high dimensional linear classification. In theory, we build a bridge to connect the estimation error of the mean difference and the misclassification error, also provide sufficient conditions of sub-optimal classifiers and optimal classifiers. In implementation, a variational Bayes algorithm is developed to compute the posterior efficiently and could be parallelized to deal with the ultra-high dimensional case.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2020

Convergence Rates of Empirical Bayes Posterior Distributions: A Variational Perspective

We study the convergence rates of empirical Bayes posterior distribution...
research
07/31/2020

Variational approximations of empirical Bayes posteriors in high-dimensional linear models

In high-dimensions, the prior tails can have a significant effect on bot...
research
04/15/2019

Variational Bayes for high-dimensional linear regression with sparse priors

We study a mean-field variational Bayes (VB) approximation to Bayesian m...
research
06/09/2022

Empirical Bayes approach to Truth Discovery problems

When aggregating information from conflicting sources, one's goal is to ...
research
08/24/2019

Consistent Classification with Generalized Metrics

We propose a framework for constructing and analyzing multiclass and mul...
research
05/31/2019

High Dimensional Classification via Empirical Risk Minimization: Improvements and Optimality

In this article, we investigate a family of classification algorithms de...
research
02/26/2020

The role of regularization in classification of high-dimensional noisy Gaussian mixture

We consider a high-dimensional mixture of two Gaussians in the noisy reg...

Please sign up or login with your details

Forgot password? Click here to reset