A Point in the Right Direction: Vector Prediction for Spatially-aware Self-supervised Volumetric Representation Learning

11/15/2022
by   Yejia Zhang, et al.
0

High annotation costs and limited labels for dense 3D medical imaging tasks have recently motivated an assortment of 3D self-supervised pretraining methods that improve transfer learning performance. However, these methods commonly lack spatial awareness despite its centrality in enabling effective 3D image analysis. More specifically, position, scale, and orientation are not only informative but also automatically available when generating image crops for training. Yet, to date, no work has proposed a pretext task that distills all key spatial features. To fulfill this need, we develop a new self-supervised method, VectorPOSE, which promotes better spatial understanding with two novel pretext tasks: Vector Prediction (VP) and Boundary-Focused Reconstruction (BFR). VP focuses on global spatial concepts (i.e., properties of 3D patches) while BFR addresses weaknesses of recent reconstruction methods to learn more effective local representations. We evaluate VectorPOSE on three 3D medical image segmentation tasks, showing that it often outperforms state-of-the-art methods, especially in limited annotation settings.

READ FULL TEXT

page 1

page 2

research
07/17/2022

Self-Supervised-RCNN for Medical Image Segmentation with Limited Data Annotation

Many successful methods developed for medical image analysis that are ba...
research
09/25/2022

Dive into Self-Supervised Learning for Medical Image Analysis: Data, Models and Tasks

Self-supervised learning (SSL) has achieved remarkable performance on va...
research
06/15/2023

Advancing Volumetric Medical Image Segmentation via Global-Local Masked Autoencoder

Masked autoencoder (MAE) has emerged as a promising self-supervised pret...
research
06/15/2023

A Comparison of Self-Supervised Pretraining Approaches for Predicting Disease Risk from Chest Radiograph Images

Deep learning is the state-of-the-art for medical imaging tasks, but req...
research
02/27/2023

MPS-AMS: Masked Patches Selection and Adaptive Masking Strategy Based Self-Supervised Medical Image Segmentation

Existing self-supervised learning methods based on contrastive learning ...
research
06/18/2023

Enhanced Masked Image Modeling for Analysis of Dental Panoramic Radiographs

The computer-assisted radiologic informative report has received increas...
research
12/14/2020

Aggregative Self-Supervised Feature Learning

Self-supervised learning (SSL) is an efficient approach that addresses t...

Please sign up or login with your details

Forgot password? Click here to reset