Contrastive and Selective Hidden Embeddings for Medical Image Segmentation

01/21/2022
by   Zhuowei Li, et al.
9

Medical image segmentation has been widely recognized as a pivot procedure for clinical diagnosis, analysis, and treatment planning. However, the laborious and expensive annotation process lags down the speed of further advances. Contrastive learning-based weight pre-training provides an alternative by leveraging unlabeled data to learn a good representation. In this paper, we investigate how contrastive learning benefits the general supervised medical segmentation tasks. To this end, patch-dragsaw contrastive regularization (PDCR) is proposed to perform patch-level tugging and repulsing with the extent controlled by a continuous affinity score. And a new structure dubbed uncertainty-aware feature selection block (UAFS) is designed to perform the feature selection process, which can handle the learning target shift caused by minority features with high uncertainty. By plugging the proposed 2 modules into the existing segmentation architecture, we achieve state-of-the-art results across 8 public datasets from 6 domains. Newly designed modules further decrease the amount of training data to a quarter while achieving comparable, if not better, performances. From this perspective, we take the opposite direction of the original self/un-supervised contrastive learning by further excavating information contained within the label.

READ FULL TEXT

page 4

page 8

research
09/21/2023

Multi-level Asymmetric Contrastive Learning for Medical Image Segmentation Pre-training

Contrastive learning, which is a powerful technique for learning image-l...
research
04/03/2022

Exemplar Learning for Medical Image Segmentation

Medical image annotation typically requires expert knowledge and hence i...
research
03/04/2022

MixCL: Pixel label matters to contrastive learning

Contrastive learning and self-supervised techniques have gained prevalen...
research
11/17/2020

Contrastive Registration for Unsupervised Medical Image Segmentation

Medical image segmentation is a relevant task as it serves as the first ...
research
11/15/2022

Unsupervised Feature Clustering Improves Contrastive Representation Learning for Medical Image Segmentation

Self-supervised instance discrimination is an effective contrastive pret...
research
06/25/2023

Scribble-supervised Cell Segmentation Using Multiscale Contrastive Regularization

Current state-of-the-art supervised deep learning-based segmentation app...
research
10/24/2022

Large Batch and Patch Size Training for Medical Image Segmentation

Multi-organ segmentation enables organ evaluation, accounts the relation...

Please sign up or login with your details

Forgot password? Click here to reset