Fine-Grained Self-Supervised Learning with Jigsaw Puzzles for Medical Image Classification

by   Wongi Park, et al.

Classifying fine-grained lesions is challenging due to minor and subtle differences in medical images. This is because learning features of fine-grained lesions with highly minor differences is very difficult in training deep neural networks. Therefore, in this paper, we introduce Fine-Grained Self-Supervised Learning(FG-SSL) method for classifying subtle lesions in medical images. The proposed method progressively learns the model through hierarchical block such that the cross-correlation between the fine-grained Jigsaw puzzle and regularized original images is close to the identity matrix. We also apply hierarchical block for progressive fine-grained learning, which extracts different information in each step, to supervised learning for discovering subtle differences. Our method does not require an asymmetric model, nor does a negative sampling strategy, and is not sensitive to batch size. We evaluate the proposed fine-grained self-supervised learning method on comprehensive experiments using various medical image recognition datasets. In our experiments, the proposed method performs favorably compared to existing state-of-the-art approaches on the widely-used ISIC2018, APTOS2019, and ISIC2017 datasets.


page 10

page 11


Self-Supervised Learning for Fine-Grained Image Classification

Fine-grained image classification involves identifying different subcate...

Self-Supervised Learning for Gastritis Detection with Gastric X-Ray Images

We propose a novel self-supervised learning method for medical image ana...

Embedding Task Knowledge into 3D Neural Networks via Self-supervised Learning

Deep learning highly relies on the amount of annotated data. However, an...

Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygiene

This paper contributes a new high-quality dataset for hand gesture recog...

Automatic Fine-grained Glomerular Lesion Recognition in Kidney Pathology

Recognition of glomeruli lesions is the key for diagnosis and treatment ...

Learning Common Rationale to Improve Self-Supervised Representation for Fine-Grained Visual Recognition Problems

Self-supervised learning (SSL) strategies have demonstrated remarkable p...

Please sign up or login with your details

Forgot password? Click here to reset