A Normative Model of Classifier Fusion

by   Susanne Trick, et al.

Combining the outputs of multiple classifiers or experts into a single probabilistic classification is a fundamental task in machine learning with broad applications from classifier fusion to expert opinion pooling. Here we present a hierarchical Bayesian model of probabilistic classifier fusion based on a new correlated Dirichlet distribution. This distribution explicitly models positive correlations between marginally Dirichlet-distributed random vectors thereby allowing normative modeling of correlations between base classifiers or experts. The proposed model naturally accommodates the classic Independent Opinion Pool and other independent fusion algorithms as special cases. It is evaluated by uncertainty reduction and correctness of fusion on synthetic and real-world data sets. We show that a change in performance of the fused classifier due to uncertainty reduction can be Bayes optimal even for highly correlated base classifiers.



page 1

page 2

page 3

page 4


Multimodal Uncertainty Reduction for Intention Recognition in Human-Robot Interaction

Assistive robots can potentially improve the quality of life and persona...

A Bivariate Beta Distribution with Arbitrary Beta Marginals and its Generalization to a Correlated Dirichlet Distribution

We discuss a bivariate beta distribution that can model arbitrary beta-d...

Probability-driven scoring functions in combining linear classifiers

Although linear classifiers are one of the oldest methods in machine lea...

Building an Ensemble of Classifiers via Randomized Models of Ensemble Members

Many dynamic ensemble selection (DES) methods are known in the literatur...

A Generative Bayesian Model for Aggregating Experts' Probabilities

In order to improve forecasts, a decisionmaker often combines probabilit...

Evaluating Classifiers Without Expert Labels

This paper considers the challenge of evaluating a set of classifiers, a...

PAC-Bayesian Majority Vote for Late Classifier Fusion

A lot of attention has been devoted to multimedia indexing over the past...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.