DeepAI

# Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification

We consider the problem of multi-label classification where the labels lie in a hierarchy. However, unlike most existing works in hierarchical multi-label classification, we do not assume that the label-hierarchy is known. Encouraged by the recent success of hyperbolic embeddings in capturing hierarchical relations, we propose to jointly learn the classifier parameters as well as the label embeddings. Such a joint learning is expected to provide a twofold advantage: i) the classifier generalizes better as it leverages the prior knowledge of existence of a hierarchy over the labels, and ii) in addition to the label co-occurrence information, the label-embedding may benefit from the manifold structure of the input datapoints, leading to embeddings that are more faithful to the label hierarchy. We propose a novel formulation for the joint learning and empirically evaluate its efficacy. The results show that the joint learning improves over the baseline that employs label co-occurrence based pre-trained hyperbolic embeddings. Moreover, the proposed classifiers achieve state-of-the-art generalization on standard benchmarks. We also present evaluation of the hyperbolic embeddings obtained by joint learning and show that they represent the hierarchy more accurately than the other alternatives.

• 4 publications
• 11 publications
• 45 publications
• 2 publications
12/07/2018

### LNEMLC: Label Network Embeddings for Multi-Label Classification

Multi-label classification aims to classify instances with discrete non-...
12/22/2014

### On Learning Vector Representations in Hierarchical Label Spaces

An important problem in multi-label classification is to capture label p...
05/26/2019

### Hyperbolic Interaction Model For Hierarchical Multi-Label Classification

Different from the traditional classification tasks which assume mutual ...
04/02/2020

### Hierarchical Image Classification using Entailment Cone Embeddings

Image classification has been studied extensively, but there has been li...
06/17/2022

### All Mistakes Are Not Equal: Comprehensive Hierarchy Aware Multi-label Predictions (CHAMP)

This paper considers the problem of Hierarchical Multi-Label Classificat...
03/18/2019

### Low-rank approximations of hyperbolic embeddings

The hyperbolic manifold is a smooth manifold of negative constant curvat...
04/02/2020

### Learning Representations For Images With Hierarchical Labels

Image classification has been studied extensively but there has been lim...