Exploring Self-Supervised Representation Learning For Low-Resource Medical Image Analysis

03/03/2023
by   Soumitri Chattopadhyay, et al.
0

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the assumption of data availability is unrealistic and impractical, as the data itself is scanty and found in small databases, collected for specific prognosis tasks. To this end, we seek to investigate the applicability of self-supervised learning algorithms on small-scale medical imaging datasets. In particular, we evaluate 4 state-of-the-art SSL methods on three publicly accessible small medical imaging datasets. Our investigation reveals that in-domain low-resource SSL pre-training can yield competitive performance to transfer learning from large-scale datasets (such as ImageNet). Furthermore, we extensively analyse our empirical findings to provide valuable insights that can motivate for further research towards circumventing the need for pre-training on a large image corpus. To the best of our knowledge, this is the first attempt to holistically explore self-supervision on low-resource medical datasets.

READ FULL TEXT
research
08/12/2021

A Systematic Benchmarking Analysis of Transfer Learning for Medical Image Analysis

Transfer learning from supervised ImageNet models has been frequently us...
research
02/10/2023

Self-Supervised Learning-Based Cervical Cytology Diagnostics in Low-Data Regime and Low-Resource Setting

Screening Papanicolaou test samples effectively reduces cervical cancer-...
research
08/15/2023

Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Images

Pre-training datasets, like ImageNet, have become the gold standard in m...
research
03/09/2023

An Evaluation of Non-Contrastive Self-Supervised Learning for Federated Medical Image Analysis

Privacy and annotation bottlenecks are two major issues that profoundly ...
research
04/20/2023

Complex Mixer for MedMNIST Classification Decathlon

With the development of the medical image field, researchers seek to dev...
research
12/29/2022

3D Masked Modelling Advances Lesion Classification in Axial T2w Prostate MRI

Masked Image Modelling (MIM) has been shown to be an efficient self-supe...
research
07/06/2022

Histopathology DatasetGAN: Synthesizing Large-Resolution Histopathology Datasets

Self-supervised learning (SSL) methods are enabling an increasing number...

Please sign up or login with your details

Forgot password? Click here to reset