Towards better understanding and better generalization of few-shot classification in histology images with contrastive learning

02/18/2022
by   Jiawei Yang, et al.
6

Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we facilitate the study of few-shot learning in histology images by setting up three cross-domain tasks that simulate real clinics problems. To enable label-efficient learning and better generalizability, we propose to incorporate contrastive learning (CL) with latent augmentation (LA) to build a few-shot system. CL learns useful representations without manual labels, while LA transfers semantic variations of the base dataset in an unsupervised way. These two components fully exploit unlabeled training data and can scale gracefully to other label-hungry problems. In experiments, we find i) models learned by CL generalize better than supervised learning for histology images in unseen classes, and ii) LA brings consistent gains over baselines. Prior studies of self-supervised learning mainly focus on ImageNet-like images, which only present a dominant object in their centers. Recent attention has been paid to images with multi-objects and multi-textures. Histology images are a natural choice for such a study. We show the superiority of CL over supervised learning in terms of generalization for such data and provide our empirical understanding for this observation. The findings in this work could contribute to understanding how the model generalizes in the context of both representation learning and histological image analysis. Code is available.

READ FULL TEXT

page 8

page 15

page 16

page 25

page 26

page 27

page 28

page 29

research
08/23/2020

Few-Shot Image Classification via Contrastive Self-Supervised Learning

Most previous few-shot learning algorithms are based on meta-training wi...
research
02/05/2022

Exemplar-Based Contrastive Self-Supervised Learning with Few-Shot Class Incremental Learning

Humans are capable of learning new concepts from only a few (labeled) ex...
research
05/25/2021

Few-Shot Learning with Part Discovery and Augmentation from Unlabeled Images

Few-shot learning is a challenging task since only few instances are giv...
research
03/23/2020

Additive Angular Margin for Few Shot Learning to Classify Clinical Endoscopy Images

Endoscopy is a widely used imaging modality to diagnose and treat diseas...
research
06/21/2022

Few-Max: Few-Shot Domain Adaptation for Unsupervised Contrastive Representation Learning

Contrastive self-supervised learning methods learn to map data points su...
research
06/27/2020

PCLNet: A Practical Way for Unsupervised Deep PolSAR Representations and Few-Shot Classification

Deep learning and convolutional neural networks (CNNs) have made progres...
research
10/09/2021

Unsupervised Representation Learning Meets Pseudo-Label Supervised Self-Distillation: A New Approach to Rare Disease Classification

Rare diseases are characterized by low prevalence and are often chronica...

Please sign up or login with your details

Forgot password? Click here to reset