DeepAI AI Chat
Log In Sign Up

A Numerical Example on the Principles of Stochastic Discrimination

by   Tin Kam Ho, et al.

Studies on ensemble methods for classification suffer from the difficulty of modeling the complementary strengths of the components. Kleinberg's theory of stochastic discrimination (SD) addresses this rigorously via mathematical notions of enrichment, uniformity, and projectability of an ensemble. We explain these concepts via a very simple numerical example that captures the basic principles of the SD theory and method. We focus on a fundamental symmetry in point set covering that is the key observation leading to the foundation of the theory. We believe a better understanding of the SD method will lead to developments of better tools for analyzing other ensemble methods.


page 17

page 18


Rethinking Fano's Inequality in Ensemble Learning

We propose a fundamental theory on ensemble learning that evaluates a gi...

𝒫𝒯-Symmetric Quantum State Discrimination for Attack on BB84 Quantum Key Distribution

Quantum Key Distribution or QKD provides symmetric key distribution usin...

A Normative approach to Attest Digital Discrimination

Digital discrimination is a form of discrimination whereby users are aut...

Emulating the First Principles of Matter: A Probabilistic Roadmap

This chapter provides a tutorial overview of first principles methods to...

Iterative Ensemble Kalman Methods: A Unified Perspective with Some New Variants

This paper provides a unified perspective of iterative ensemble Kalman m...

Variational approach to unsupervised learning

Deep belief networks are used extensively for unsupervised stochastic le...

Fiducial Symmetry in Action

Symmetry is key in classical and modern physics. A striking example is c...