SEAL: Simultaneous Label Hierarchy Exploration And Learning

04/26/2023
by   Zhiquan Tan, et al.
13

Label hierarchy is an important source of external knowledge that can enhance classification performance. However, most existing methods rely on predefined label hierarchies that may not match the data distribution. To address this issue, we propose Simultaneous label hierarchy Exploration And Learning (SEAL), a new framework that explores the label hierarchy by augmenting the observed labels with latent labels that follow a prior hierarchical structure. Our approach uses a 1-Wasserstein metric over the tree metric space as an objective function, which enables us to simultaneously learn a data-driven label hierarchy and perform (semi-)supervised learning. We evaluate our method on several datasets and show that it achieves superior results in both supervised and semi-supervised scenarios and reveals insightful label structures. Our implementation is available at https://github.com/tzq1999/SEAL.

READ FULL TEXT

page 15

page 16

research
10/30/2021

HIERMATCH: Leveraging Label Hierarchies for Improving Semi-Supervised Learning

Semi-supervised learning approaches have emerged as an active area of re...
research
04/27/2022

Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework

Current contrastive learning frameworks focus on leveraging a single sup...
research
12/22/2014

On Learning Vector Representations in Hierarchical Label Spaces

An important problem in multi-label classification is to capture label p...
research
07/26/2022

Learning Hierarchy Aware Features for Reducing Mistake Severity

Label hierarchies are often available apriori as part of biological taxo...
research
10/06/2021

SNEAK: Faster Interactive Search-based Software Engineering (using Semi-Supervised Learning)

When reasoning over complex models, AI tools can generate too many solut...
research
12/04/2021

Label Hierarchy Transition: Modeling Class Hierarchies to Enhance Deep Classifiers

Hierarchical classification aims to sort the object into a hierarchy of ...
research
03/27/2020

Towards Discriminability and Diversity: Batch Nuclear-norm Maximization under Label Insufficient Situations

The learning of the deep networks largely relies on the data with human-...

Please sign up or login with your details

Forgot password? Click here to reset