Embedding Task Knowledge into 3D Neural Networks via Self-supervised Learning

06/10/2020
by   Jiuwen Zhu, et al.
0

Deep learning highly relies on the amount of annotated data. However, annotating medical images is extremely laborious and expensive. To this end, self-supervised learning (SSL), as a potential solution for deficient annotated data, attracts increasing attentions from the community. However, SSL approaches often design a proxy task that is not necessarily related to target task. In this paper, we propose a novel SSL approach for 3D medical image classification, namely Task-related Contrastive Prediction Coding (TCPC), which embeds task knowledge into training 3D neural networks. The proposed TCPC first locates the initial candidate lesions via supervoxel estimation using simple linear iterative clustering. Then, we extract features from the sub-volume cropped around potential lesion areas, and construct a calibrated contrastive predictive coding scheme for self-supervised learning. Extensive experiments are conducted on public and private datasets. The experimental results demonstrate the effectiveness of embedding lesion-related prior-knowledge into neural networks for 3D medical image classification.

READ FULL TEXT

page 4

page 6

research
02/10/2023

A Review of Predictive and Contrastive Self-supervised Learning for Medical Images

Over the last decade, supervised deep learning on manually annotated big...
research
10/05/2019

Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik's Cube

Witnessed the development of deep learning, increasing number of studies...
research
07/17/2021

Lesion-based Contrastive Learning for Diabetic Retinopathy Grading from Fundus Images

Manually annotating medical images is extremely expensive, especially fo...
research
09/28/2022

Efficient Medical Image Assessment via Self-supervised Learning

High-performance deep learning methods typically rely on large annotated...
research
08/10/2023

Fine-Grained Self-Supervised Learning with Jigsaw Puzzles for Medical Image Classification

Classifying fine-grained lesions is challenging due to minor and subtle ...
research
12/14/2020

Aggregative Self-Supervised Feature Learning

Self-supervised learning (SSL) is an efficient approach that addresses t...
research
06/24/2022

Self Supervised Learning for Few Shot Hyperspectral Image Classification

Deep learning has proven to be a very effective approach for Hyperspectr...

Please sign up or login with your details

Forgot password? Click here to reset