Supervised Contrastive Learning on Blended Images for Long-tailed Recognition

11/22/2022
by   Minki Jeong, et al.
0

Real-world data often have a long-tailed distribution, where the number of samples per class is not equal over training classes. The imbalanced data form a biased feature space, which deteriorates the performance of the recognition model. In this paper, we propose a novel long-tailed recognition method to balance the latent feature space. First, we introduce a MixUp-based data augmentation technique to reduce the bias of the long-tailed data. Furthermore, we propose a new supervised contrastive learning method, named Supervised contrastive learning on Mixed Classes (SMC), for blended images. SMC creates a set of positives based on the class labels of the original images. The combination ratio of positives weights the positives in the training loss. SMC with the class-mixture-based loss explores more diverse data space, enhancing the generalization capability of the model. Extensive experiments on various benchmarks show the effectiveness of our one-stage training method.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 8

research
03/22/2022

Rebalanced Siamese Contrastive Mining for Long-Tailed Recognition

Deep neural networks perform poorly on heavily class-imbalanced datasets...
research
11/06/2021

Towards Calibrated Model for Long-Tailed Visual Recognition from Prior Perspective

Real-world data universally confronts a severe class-imbalance problem a...
research
12/01/2021

The Majority Can Help The Minority: Context-rich Minority Oversampling for Long-tailed Classification

The problem of class imbalanced data lies in that the generalization per...
research
07/14/2022

An Asymmetric Contrastive Loss for Handling Imbalanced Datasets

Contrastive learning is a representation learning method performed by co...
research
06/08/2023

On the Effectiveness of Out-of-Distribution Data in Self-Supervised Long-Tail Learning

Though Self-supervised learning (SSL) has been widely studied as a promi...
research
08/29/2023

Robust Long-Tailed Learning via Label-Aware Bounded CVaR

Data in the real-world classification problems are always imbalanced or ...
research
05/02/2023

Long-Tailed Recognition by Mutual Information Maximization between Latent Features and Ground-Truth Labels

Although contrastive learning methods have shown prevailing performance ...

Please sign up or login with your details

Forgot password? Click here to reset