Evaluation Measures for Hierarchical Classification: a unified view and novel approaches

06/28/2013
by   Aris Kosmopoulos, et al.
0

Hierarchical classification addresses the problem of classifying items into a hierarchy of classes. An important issue in hierarchical classification is the evaluation of different classification algorithms, which is complicated by the hierarchical relations among the classes. Several evaluation measures have been proposed for hierarchical classification using the hierarchy in different ways. This paper studies the problem of evaluation in hierarchical classification by analyzing and abstracting the key components of the existing performance measures. It also proposes two alternative generic views of hierarchical evaluation and introduces two corresponding novel measures. The proposed measures, along with the state-of-the art ones, are empirically tested on three large datasets from the domain of text classification. The empirical results illustrate the undesirable behavior of existing approaches and how the proposed methods overcome most of these methods across a range of cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2022

Exploiting Global and Local Hierarchies for Hierarchical Text Classification

Hierarchical text classification aims to leverage label hierarchy in mul...
research
09/24/2017

HDLTex: Hierarchical Deep Learning for Text Classification

The continually increasing number of documents produced each year necess...
research
06/05/2017

Inconsistent Node Flattening for Improving Top-down Hierarchical Classification

Large-scale classification of data where classes are structurally organi...
research
03/02/2016

Filter based Taxonomy Modification for Improving Hierarchical Classification

Hierarchical Classification (HC) is a supervised learning problem where ...
research
08/02/2023

Global Hierarchical Neural Networks using Hierarchical Softmax

This paper presents a framework in which hierarchical softmax is used to...
research
06/15/2023

Hierarchical confusion matrix for classification performance evaluation

In this work we propose a novel concept of a hierarchical confusion matr...
research
11/22/2021

Hierarchy Decoder is All You Need To Text Classification

Hierarchical text classification (HTC) to a taxonomy is essential for va...

Please sign up or login with your details

Forgot password? Click here to reset