Bounds on the Bayes Error Given Moments

05/15/2011
by   Bela A. Frigyik, et al.
0

We show how to compute lower bounds for the supremum Bayes error if the class-conditional distributions must satisfy moment constraints, where the supremum is with respect to the unknown class-conditional distributions. Our approach makes use of Curto and Fialkow's solutions for the truncated moment problem. The lower bound shows that the popular Gaussian assumption is not robust in this regard. We also construct an upper bound for the supremum Bayes error by constraining the decision boundary to be linear.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/20/2014

Generalized Bhattacharyya and Chernoff upper bounds on Bayes error using quasi-arithmetic means

Bayesian classification labels observations based on given prior informa...
research
06/02/2018

Optimal Clustering under Uncertainty

Classical clustering algorithms typically either lack an underlying prob...
research
05/28/2018

High Probability Frequency Moment Sketches

We consider the problem of sketching the p-th frequency moment of a vect...
research
12/29/2018

Non-Asymptotic Chernoff Lower Bound and Its Application to Community Detection in Stochastic Block Model

Chernoff coefficient is an upper bound of Bayes error probability in cla...
research
01/09/2020

An Internal Covariate Shift Bounding Algorithm for Deep Neural Networks by Unitizing Layers' Outputs

Batch Normalization (BN) techniques have been proposed to reduce the so-...
research
06/07/2021

Evaluating State-of-the-Art Classification Models Against Bayes Optimality

Evaluating the inherent difficulty of a given data-driven classification...
research
04/09/2021

Identification of Dynamic Panel Logit Models with Fixed Effects

We show that the identification problem for a class of dynamic panel log...

Please sign up or login with your details

Forgot password? Click here to reset