Global Contrast Masked Autoencoders Are Powerful Pathological Representation Learners

05/18/2022
by   Hao Quan, et al.
0

Based on digital whole slide scanning technique, artificial intelligence algorithms represented by deep learning have achieved remarkable results in the field of computational pathology. Compared with other medical images such as Computed Tomography (CT) or Magnetic Resonance Imaging (MRI), pathological images are more difficult to annotate, thus there is an extreme lack of data sets that can be used for supervised learning. In this study, a self-supervised learning (SSL) model, Global Contrast Masked Autoencoders (GCMAE), is proposed, which has the ability to represent both global and local domain-specific features of whole slide image (WSI), as well as excellent cross-data transfer ability. The Camelyon16 and NCTCRC datasets are used to evaluate the performance of our model. When dealing with transfer learning tasks with different data sets, the experimental results show that GCMAE has better linear classification accuracy than MAE, which can reach 81.10 respectively. Our method outperforms the previous state-of-the-art algorithm and even surpass supervised learning (improved by 3.86 The source code of this paper is publicly available at https://github.com/StarUniversus/gcmae

READ FULL TEXT
research
01/04/2022

Self-supervised Learning from 100 Million Medical Images

Building accurate and robust artificial intelligence systems for medical...
research
10/11/2022

Self-supervised Model Based on Masked Autoencoders Advance CT Scans Classification

The coronavirus pandemic has been going on since the year 2019, and the ...
research
05/19/2022

Free Lunch for Surgical Video Understanding by Distilling Self-Supervisions

Self-supervised learning has witnessed great progress in vision and NLP;...
research
07/20/2021

ReSSL: Relational Self-Supervised Learning with Weak Augmentation

Self-supervised Learning (SSL) including the mainstream contrastive lear...
research
08/21/2023

GBM-based Bregman Proximal Algorithms for Constrained Learning

As the complexity of learning tasks surges, modern machine learning enco...
research
11/21/2022

Novel transfer learning schemes based on Siamese networks and synthetic data

Transfer learning schemes based on deep networks which have been trained...
research
10/04/2022

VICRegL: Self-Supervised Learning of Local Visual Features

Most recent self-supervised methods for learning image representations f...

Please sign up or login with your details

Forgot password? Click here to reset