Using the Order of Tomographic Slices as a Prior for Neural Networks Pre-Training

03/17/2022
by   Yaroslav Zharov, et al.
0

The technical advances in Computed Tomography (CT) allow to obtain immense amounts of 3D data. For such datasets it is very costly and time-consuming to obtain the accurate 3D segmentation markup to train neural networks. The annotation is typically done for a limited number of 2D slices, followed by an interpolation. In this work, we propose a pre-training method SortingLoss. It performs pre-training on slices instead of volumes, so that a model could be fine-tuned on a sparse set of slices, without the interpolation step. Unlike general methods (e.g. SimCLR or Barlow Twins), the task specific methods (e.g. Transferable Visual Words) trade broad applicability for quality benefits by imposing stronger assumptions on the input data. We propose a relatively mild assumption – if we take several slices along some axis of a volume, structure of the sample presented on those slices, should give a strong clue to reconstruct the correct order of those slices along the axis. Many biomedical datasets fulfill this requirement due to the specific anatomy of a sample and pre-defined alignment of the imaging setup. We examine the proposed method on two datasets: medical CT of lungs affected by COVID-19 disease, and high-resolution synchrotron-based full-body CT of model organisms (Medaka fish). We show that the proposed method performs on par with SimCLR, while working 2x faster and requiring 1.5x less memory. In addition, we present the benefits in terms of practical scenarios, especially the applicability to the pre-training of large models and the ability to localize samples within volumes in an unsupervised setup.

READ FULL TEXT
research
12/16/2020

Revisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices

Universal lesion detection from computed tomography (CT) slices is impor...
research
02/11/2020

HRINet: Alternative Supervision Network for High-resolution CT image Interpolation

Image interpolation in medical area is of high importance as most 3D bio...
research
07/24/2023

Sparse annotation strategies for segmentation of short axis cardiac MRI

Short axis cardiac MRI segmentation is a well-researched topic, with exc...
research
07/04/2022

Adaptive GLCM sampling for transformer-based COVID-19 detection on CT

The world has suffered from COVID-19 (SARS-CoV-2) for the last two years...
research
05/16/2023

Annotating 8,000 Abdominal CT Volumes for Multi-Organ Segmentation in Three Weeks

Annotating medical images, particularly for organ segmentation, is labor...
research
10/01/2021

CCS-GAN: COVID-19 CT-scan classification with very few positive training images

We present a novel algorithm that is able to classify COVID-19 pneumonia...
research
06/04/2019

A Multi-Pass GAN for Fluid Flow Super-Resolution

We propose a novel method to up-sample volumetric functions with generat...

Please sign up or login with your details

Forgot password? Click here to reset