DeepAI AI Chat
Log In Sign Up

Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification

by   Soumya Chatterjee, et al.
Indian Institute of Technology Hyderabad
IIT Bombay

We consider the problem of multi-label classification where the labels lie in a hierarchy. However, unlike most existing works in hierarchical multi-label classification, we do not assume that the label-hierarchy is known. Encouraged by the recent success of hyperbolic embeddings in capturing hierarchical relations, we propose to jointly learn the classifier parameters as well as the label embeddings. Such a joint learning is expected to provide a twofold advantage: i) the classifier generalizes better as it leverages the prior knowledge of existence of a hierarchy over the labels, and ii) in addition to the label co-occurrence information, the label-embedding may benefit from the manifold structure of the input datapoints, leading to embeddings that are more faithful to the label hierarchy. We propose a novel formulation for the joint learning and empirically evaluate its efficacy. The results show that the joint learning improves over the baseline that employs label co-occurrence based pre-trained hyperbolic embeddings. Moreover, the proposed classifiers achieve state-of-the-art generalization on standard benchmarks. We also present evaluation of the hyperbolic embeddings obtained by joint learning and show that they represent the hierarchy more accurately than the other alternatives.


LNEMLC: Label Network Embeddings for Multi-Label Classification

Multi-label classification aims to classify instances with discrete non-...

On Learning Vector Representations in Hierarchical Label Spaces

An important problem in multi-label classification is to capture label p...

Hyperbolic Interaction Model For Hierarchical Multi-Label Classification

Different from the traditional classification tasks which assume mutual ...

Hierarchical Image Classification using Entailment Cone Embeddings

Image classification has been studied extensively, but there has been li...

All Mistakes Are Not Equal: Comprehensive Hierarchy Aware Multi-label Predictions (CHAMP)

This paper considers the problem of Hierarchical Multi-Label Classificat...

Low-rank approximations of hyperbolic embeddings

The hyperbolic manifold is a smooth manifold of negative constant curvat...

Learning Representations For Images With Hierarchical Labels

Image classification has been studied extensively but there has been lim...