Delta divergence: A novel decision cognizant measure of classifier incongruence

04/15/2016
by   Josef Kittler, et al.
0

Disagreement between two classifiers regarding the class membership of an observation in pattern recognition can be indicative of an anomaly and its nuance. As in general classifiers base their decision on class aposteriori probabilities, the most natural approach to detecting classifier incongruence is to use divergence. However, existing divergences are not particularly suitable to gauge classifier incongruence. In this paper, we postulate the properties that a divergence measure should satisfy and propose a novel divergence measure, referred to as Delta divergence. In contrast to existing measures, it is decision cognizant. The focus in Delta divergence on the dominant hypotheses has a clutter reducing property, the significance of which grows with increasing number of classes. The proposed measure satisfies other important properties such as symmetry, and independence of classifier confidence. The relationship of the proposed divergence to some baseline measures is demonstrated experimentally, showing its superiority.

READ FULL TEXT

page 5

page 9

research
08/19/2018

Generalized Bregman and Jensen divergences which include some f-divergences

In this paper, we introduce new classes of divergences by extending the ...
research
01/15/2021

Is the Chen-Sbert Divergence a Metric?

Recently, Chen and Sbert proposed a general divergence measure. This rep...
research
09/21/2016

On Data-Independent Properties for Density-Based Dissimilarity Measures in Hybrid Clustering

Hybrid clustering combines partitional and hierarchical clustering for c...
research
06/06/2021

Reducing the feature divergence of RGB and near-infrared images using Switchable Normalization

Visual pattern recognition over agricultural areas is an important appli...
research
08/04/2014

Multithreshold Entropy Linear Classifier

Linear classifiers separate the data with a hyperplane. In this paper we...
research
04/15/2022

On Variants of Root Normalised Order-aware Divergence and a Divergence based on Kendall's Tau

This paper reports on a follow-up study of the work reported in Sakai, w...
research
05/07/2013

A new framework for optimal classifier design

The use of alternative measures to evaluate classifier performance is ga...

Please sign up or login with your details

Forgot password? Click here to reset