Efficient Self-Supervision using Patch-based Contrastive Learning for Histopathology Image Segmentation

08/23/2022
by   Nicklas Boserup, et al.
0

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext tasks. In this work, we propose a simple and efficient framework for self-supervised image segmentation using contrastive learning on image patches, without using explicit pretext tasks or any further labeled fine-tuning. A fully convolutional neural network (FCNN) is trained in a self-supervised manner to discern features in the input images and obtain confidence maps which capture the network's belief about the objects belonging to the same class. Positive- and negative- patches are sampled based on the average entropy in the confidence maps for contrastive learning. Convergence is assumed when the information separation between the positive patches is small, and the positive-negative pairs is large. We evaluate this method for the task of segmenting nuclei from multiple histopathology datasets, and show comparable performance with relevant self-supervised and supervised methods. The proposed model only consists of a simple FCNN with 10.8k parameters and requires about 5 minutes to converge on the high resolution microscopy datasets, which is orders of magnitude smaller than the relevant self-supervised methods to attain similar performance.

READ FULL TEXT

page 5

page 11

page 14

research
03/15/2022

SCD: Self-Contrastive Decorrelation for Sentence Embeddings

In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-s...
research
01/12/2021

Explicit homography estimation improves contrastive self-supervised learning

The typical contrastive self-supervised algorithm uses a similarity meas...
research
03/02/2023

Hierarchical discriminative learning improves visual representations of biomedical microscopy

Learning high-quality, self-supervised, visual representations is essent...
research
03/28/2023

Data Efficient Contrastive Learning in Histopatholgy using Active Sampling

Deep Learning based diagnostics systems can provide accurate and robust ...
research
07/18/2023

CSSL-RHA: Contrastive Self-Supervised Learning for Robust Handwriting Authentication

Handwriting authentication is a valuable tool used in various fields, su...
research
02/28/2020

Instance Separation Emerges from Inpainting

Deep neural networks trained to inpaint partially occluded images show a...
research
10/17/2022

Self-Supervised Learning Through Efference Copies

Self-supervised learning (SSL) methods aim to exploit the abundance of u...

Please sign up or login with your details

Forgot password? Click here to reset