DeepAI AI Chat
Log In Sign Up

Label Information Bottleneck for Label Enhancement

by   Qinghai Zheng, et al.
Xi'an Jiaotong University

In this work, we focus on the challenging problem of Label Enhancement (LE), which aims to exactly recover label distributions from logical labels, and present a novel Label Information Bottleneck (LIB) method for LE. For the recovery process of label distributions, the label irrelevant information contained in the dataset may lead to unsatisfactory recovery performance. To address this limitation, we make efforts to excavate the essential label relevant information to improve the recovery performance. Our method formulates the LE problem as the following two joint processes: 1) learning the representation with the essential label relevant information, 2) recovering label distributions based on the learned representation. The label relevant information can be excavated based on the "bottleneck" formed by the learned representation. Significantly, both the label relevant information about the label assignments and the label relevant information about the label gaps can be explored in our method. Evaluation experiments conducted on several benchmark label distribution learning datasets verify the effectiveness and competitiveness of LIB. Our source codes are available


Multi-Label Learning with Label Enhancement

Multi-label learning deals with training instances associated with multi...

Generalized Label Enhancement with Sample Correlations

Recently, label distribution learning (LDL) has drawn much attention in ...

Label Embedding Network: Learning Label Representation for Soft Training of Deep Networks

We propose a method, called Label Embedding Network, which can learn lab...

DaiMoN: A Decentralized Artificial Intelligence Model Network

We introduce DaiMoN, a decentralized artificial intelligence model netwo...

Label Propagation for Learning with Label Proportions

Learning with Label Proportions (LLP) is the problem of recovering the u...

Contrastive Label Enhancement

Label distribution learning (LDL) is a new machine learning paradigm for...

Label Distribution Learning from Logical Label

Label distribution learning (LDL) is an effective method to predict the ...