HierLPR: Decision making in hierarchical multi-label classification with local precision rates

10/18/2018
by   Christine Ho, et al.
0

In this article we propose a novel ranking algorithm, referred to as HierLPR, for the multi-label classification problem when the candidate labels follow a known hierarchical structure. HierLPR is motivated by a new metric called eAUC that we design to assess the ranking of classification decisions. This metric, associated with the hit curve and local precision rate, emphasizes the accuracy of the first calls. We show that HierLPR optimizes eAUC under the tree constraint and some light assumptions on the dependency between the nodes in the hierarchy. We also provide a strategy to make calls for each node based on the ordering produced by HierLPR, with the intent of controlling FDR or maximizing F-score. The performance of our proposed methods is demonstrated on synthetic datasets as well as a real example of disease diagnosis using NCBI GEO datasets. In these cases, HierLPR shows a favorable result over competing methods in the early part of the precision-recall curve.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/16/2022

Decision Making for Hierarchical Multi-label Classification with Multidimensional Local Precision Rate

Hierarchical multi-label classification (HMC) has drawn increasing atten...
research
08/18/2019

TwistBytes -- Hierarchical Classification at GermEval 2019: walking the fine line (of recall and precision)

We present here our approach to the GermEval 2019 Task 1 - Shared Task o...
research
01/31/2022

Implicit Concept Drift Detection for Multi-label Data Streams

Many real-world applications adopt multi-label data streams as the need ...
research
09/09/2022

Estimating Multi-label Accuracy using Labelset Distributions

A multi-label classifier estimates the binary label state (relevant vs i...
research
01/02/2019

Multi-Label Adversarial Perturbations

Adversarial examples are delicately perturbed inputs, which aim to misle...
research
11/15/2020

Precision-Recall Curve (PRC) Classification Trees

The classification of imbalanced data has presented a significant challe...
research
11/23/2014

Target Fishing: A Single-Label or Multi-Label Problem?

According to Cobanoglu et al and Murphy, it is now widely acknowledged t...

Please sign up or login with your details

Forgot password? Click here to reset