Phased Progressive Learning with Coupling-Regulation-Imbalance Loss for Imbalanced Classification

05/24/2022
by   Liang Xu, et al.
4

Deep neural networks generally perform poorly with datasets that suffer from quantity imbalance and classification difficulty imbalance between different classes. In order to alleviate the problem of dataset bias or domain shift in the existing two-stage approaches, a phased progressive learning schedule was proposed for smoothly transferring the training emphasis from representation learning to upper classifier training. This has greater effectivity on datasets that have more severe imbalances or smaller scales. A coupling-regulation-imbalance loss function was designed, coupling a correction term, Focal loss and LDAM loss. Coupling-regulation-imbalance loss can better deal with quantity imbalance and outliers, while regulating focus-of-attention of samples with a variety of classification difficulties. Excellent results were achieved on multiple benchmark datasets using these approaches and they can be easily generalized for other imbalanced classification models. Our code will be open source soon.

READ FULL TEXT

page 2

page 7

research
09/18/2022

Imbalanced Nodes Classification for Graph Neural Networks Based on Valuable Sample Mining

Node classification is an important task in graph neural networks, but m...
research
11/10/2022

Harmonizing Output Imbalance for semantic segmentation on extremely-imbalanced input data

Semantic segmentation is a high level computer vision task that assigns ...
research
04/12/2021

How Sensitive are Meta-Learners to Dataset Imbalance?

Meta-Learning (ML) has proven to be a useful tool for training Few-Shot ...
research
10/22/2020

Posterior Re-calibration for Imbalanced Datasets

Neural Networks can perform poorly when the training label distribution ...
research
06/05/2017

Progressive Boosting for Class Imbalance

Pattern recognition applications often suffer from skewed data distribut...
research
08/18/2020

Grading Loss: A Fracture Grade-based Metric Loss for Vertebral Fracture Detection

Osteoporotic vertebral fractures have a severe impact on patients' overa...
research
09/04/2022

ASTra: A Novel Algorithm-Level Approach to Imbalanced Classification

We propose a novel output layer activation function, which we name ASTra...

Please sign up or login with your details

Forgot password? Click here to reset