Relational Subsets Knowledge Distillation for Long-tailed Retinal Diseases Recognition

04/22/2021
by   Lie Ju, et al.
14

In the real world, medical datasets often exhibit a long-tailed data distribution (i.e., a few classes occupy most of the data, while most classes have rarely few samples), which results in a challenging imbalance learning scenario. For example, there are estimated more than 40 different kinds of retinal diseases with variable morbidity, however with more than 30+ conditions are very rare from the global patient cohorts, which results in a typical long-tailed learning problem for deep learning-based screening models. In this study, we propose class subset learning by dividing the long-tailed data into multiple class subsets according to prior knowledge, such as regions and phenotype information. It enforces the model to focus on learning the subset-specific knowledge. More specifically, there are some relational classes that reside in the fixed retinal regions, or some common pathological features are observed in both the majority and minority conditions. With those subsets learnt teacher models, then we are able to distill the multiple teacher models into a unified model with weighted knowledge distillation loss. The proposed framework proved to be effective for the long-tailed retinal diseases recognition task. The experimental results on two different datasets demonstrate that our method is flexible and can be easily plugged into many other state-of-the-art techniques with significant improvements.

READ FULL TEXT

page 2

page 3

page 4

page 7

research
11/17/2021

Long-Tailed Multi-Label Retinal Diseases Recognition Using Hierarchical Information and Hybrid Knowledge Distillation

In the real world, medical datasets often exhibit a long-tailed data dis...
research
01/06/2020

Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classification

In real-world scenarios, data tends to exhibit a long-tailed, imbalanced...
research
04/09/2023

Propheter: Prophetic Teacher Guided Long-Tailed Distribution Learning

The problem of deep long-tailed learning, a prevalent challenge in the r...
research
03/28/2021

Distilling Virtual Examples for Long-tailed Recognition

In this paper, we tackle the long-tailed visual recognition problem from...
research
04/07/2022

Flexible Sampling for Long-tailed Skin Lesion Classification

Most of the medical tasks naturally exhibit a long-tailed distribution d...
research
05/05/2023

Towards Effective Collaborative Learning in Long-Tailed Recognition

Real-world data usually suffers from severe class imbalance and long-tai...

Please sign up or login with your details

Forgot password? Click here to reset