Accurate Bayesian Data Classification without Hyperparameter Cross-validation

12/28/2017
by   M Sheikh, et al.
0

We extend the standard Bayesian multivariate Gaussian generative data classifier by considering a generalization of the conjugate, normal-Wishart prior distribution and by deriving the hyperparameters analytically via evidence maximization. The behaviour of the optimal hyperparameters is explored in the high-dimensional data regime. The classification accuracy of the resulting generalized model is competitive with state-of-the art Bayesian discriminant analysis methods, but without the usual computational burden of cross-validation.

READ FULL TEXT

page 11

page 12

research
05/18/2018

Optimizing for Generalization in Machine Learning with Cross-Validation Gradients

Cross-validation is the workhorse of modern applied statistics and machi...
research
03/27/2015

Bayesian Cross Validation and WAIC for Predictive Prior Design in Regular Asymptotic Theory

Prior design is one of the most important problems in both statistics an...
research
03/29/2020

High-dimensional Neural Feature using Rectified Linear Unit and Random Matrix Instance

We design a ReLU-based multilayer neural network to generate a rich high...
research
01/20/2021

Raspberry Pi Based Intelligent Robot that Recognizes and Places Puzzle Objects

In this study; in order to diagnose congestive heart failure (CHF) patie...
research
06/11/2019

Statistical Species Identification

Identification of taxa can be significantly assisted by statistical clas...
research
04/16/2021

Overfitting in Bayesian Optimization: an empirical study and early-stopping solution

Bayesian Optimization (BO) is a successful methodology to tune the hyper...

Please sign up or login with your details

Forgot password? Click here to reset