Distribution-Balanced Loss for Multi-Label Classification in Long-Tailed Datasets

07/19/2020
by   Tong Wu, et al.
26

We present a new loss function called Distribution-Balanced Loss for the multi-label recognition problems that exhibit long-tailed class distributions. Compared to conventional single-label classification problem, multi-label recognition problems are often more challenging due to two significant issues, namely the co-occurrence of labels and the dominance of negative labels (when treated as multiple binary classification problems). The Distribution-Balanced Loss tackles these issues through two key modifications to the standard binary cross-entropy loss: 1) a new way to re-balance the weights that takes into account the impact caused by label co-occurrence, and 2) a negative tolerant regularization to mitigate the over-suppression of negative labels. Experiments on both Pascal VOC and COCO show that the models trained with this new loss function achieve significant performance gains over existing methods. Code and models are available at: https://github.com/wutong16/DistributionBalancedLoss .

READ FULL TEXT
research
09/10/2021

Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distribution

Multi-label text classification is a challenging task because it require...
research
08/10/2023

Robust Asymmetric Loss for Multi-Label Long-Tailed Learning

In real medical data, training samples typically show long-tailed distri...
research
07/20/2021

Understanding Gender and Racial Disparities in Image Recognition Models

Large scale image classification models trained on top of popular datase...
research
05/28/2019

Using Ontologies To Improve Performance In Massively Multi-label Prediction Models

Massively multi-label prediction/classification problems arise in enviro...
research
09/14/2022

Combining Metric Learning and Attention Heads For Accurate and Efficient Multilabel Image Classification

Multi-label image classification allows predicting a set of labels from ...
research
10/13/2022

Caption supervision enables robust learners

Vision language models like CLIP are robust to natural distribution shif...
research
04/10/2023

Asymmetric Polynomial Loss For Multi-Label Classification

Various tasks are reformulated as multi-label classification problems, i...

Please sign up or login with your details

Forgot password? Click here to reset