RPLHR-CT Dataset and Transformer Baseline for Volumetric Super-Resolution from CT Scans

06/13/2022
by   Pengxin Yu, et al.
0

In clinical practice, anisotropic volumetric medical images with low through-plane resolution are commonly used due to short acquisition time and lower storage cost. Nevertheless, the coarse resolution may lead to difficulties in medical diagnosis by either physicians or computer-aided diagnosis algorithms. Deep learning-based volumetric super-resolution (SR) methods are feasible ways to improve resolution, with convolutional neural networks (CNN) at their core. Despite recent progress, these methods are limited by inherent properties of convolution operators, which ignore content relevance and cannot effectively model long-range dependencies. In addition, most of the existing methods use pseudo-paired volumes for training and evaluation, where pseudo low-resolution (LR) volumes are generated by a simple degradation of their high-resolution (HR) counterparts. However, the domain gap between pseudo- and real-LR volumes leads to the poor performance of these methods in practice. In this paper, we build the first public real-paired dataset RPLHR-CT as a benchmark for volumetric SR, and provide baseline results by re-implementing four state-of-the-art CNN-based methods. Considering the inherent shortcoming of CNN, we also propose a transformer volumetric super-resolution network (TVSRN) based on attention mechanisms, dispensing with convolutions entirely. This is the first research to use a pure transformer for CT volumetric SR. The experimental results show that TVSRN significantly outperforms all baselines on both PSNR and SSIM. Moreover, the TVSRN method achieves a better trade-off between the image quality, the number of parameters, and the running time. Data and code are available at https://github.com/smilenaxx/RPLHR-CT.

READ FULL TEXT

page 4

page 7

research
04/07/2020

Super-resolution of clinical CT volumes with modified CycleGAN using micro CT volumes

This paper presents a super-resolution (SR) method with unpaired trainin...
research
10/20/2020

Micro CT Image-Assisted Cross Modality Super-Resolution of Clinical CT Images Utilizing Synthesized Training Dataset

This paper proposes a novel, unsupervised super-resolution (SR) approach...
research
10/16/2020

VolumeNet: A Lightweight Parallel Network for Super-Resolution of Medical Volumetric Data

Deep learning-based super-resolution (SR) techniques have generally achi...
research
10/11/2022

DA-VSR: Domain Adaptable Volumetric Super-Resolution For Medical Images

Medical image super-resolution (SR) is an active research area that has ...
research
04/04/2023

BugNIST – A New Large Scale Volumetric 3D Image Dataset for Classification and Detection

Progress in 3D volumetric image analysis research is limited by the lack...
research
06/08/2023

Octree-based hierarchical sampling optimization for the volumetric super-resolution of scientific data

When introducing physics-constrained deep learning solutions to the volu...
research
03/28/2023

CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolution

Medical image arbitrary-scale super-resolution (MIASSR) has recently gai...

Please sign up or login with your details

Forgot password? Click here to reset