Unsupervised Learning of Local Discriminative Representation for Medical Images

12/17/2020
by   Huai Chen, et al.
0

Local discriminative representation is needed in many medical image analysis tasks such as identifying sub-types of lesion or segmenting detailed components of anatomical structures by measuring similarity of local image regions. However, the commonly applied supervised representation learning methods require a large amount of annotated data, and unsupervised discriminative representation learning distinguishes different images by learning a global feature. In order to avoid the limitations of these two methods and be suitable for localized medical image analysis tasks, we introduce local discrimination into unsupervised representation learning in this work. The model contains two branches: one is an embedding branch which learns an embedding function to disperse dissimilar pixels over a low-dimensional hypersphere; and the other is a clustering branch which learns a clustering function to classify similar pixels into the same cluster. These two branches are trained simultaneously in a mutually beneficial pattern, and the learnt local discriminative representations are able to well measure the similarity of local image regions. These representations can be transferred to enhance various downstream tasks. Meanwhile, they can also be applied to cluster anatomical structures from unlabeled medical images under the guidance of topological priors from simulation or other structures with similar topological characteristics. The effectiveness and usefulness of the proposed method are demonstrated by enhancing various downstream tasks and clustering anatomical structures in retinal images and chest X-ray images. The corresponding code is available at https://github.com/HuaiChen-1994/LDLearning.

READ FULL TEXT
research
08/21/2021

Unsupervised Local Discrimination for Medical Images

Contrastive representation learning is an effective unsupervised method ...
research
12/28/2022

Swin MAE: Masked Autoencoders for Small Datasets

The development of deep learning models in medical image analysis is maj...
research
03/20/2023

A Dual-branch Self-supervised Representation Learning Framework for Tumour Segmentation in Whole Slide Images

Supervised deep learning methods have achieved considerable success in m...
research
04/11/2018

Unsupervised Segmentation of 3D Medical Images Based on Clustering and Deep Representation Learning

This paper presents a novel unsupervised segmentation method for 3D medi...
research
11/14/2022

The Role of Local Alignment and Uniformity in Image-Text Contrastive Learning on Medical Images

Image-text contrastive learning has proven effective for pretraining med...
research
04/15/2022

CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging

Recently, self-supervised instance discrimination methods have achieved ...
research
06/11/2021

AugNet: End-to-End Unsupervised Visual Representation Learning with Image Augmentation

Most of the achievements in artificial intelligence so far were accompli...

Please sign up or login with your details

Forgot password? Click here to reset