MIASSR: An Approach for Medical Image Arbitrary Scale Super-Resolution

05/22/2021
by   Jin Zhu, et al.
17

Single image super-resolution (SISR) aims to obtain a high-resolution output from one low-resolution image. Currently, deep learning-based SISR approaches have been widely discussed in medical image processing, because of their potential to achieve high-quality, high spatial resolution images without the cost of additional scans. However, most existing methods are designed for scale-specific SR tasks and are unable to generalise over magnification scales. In this paper, we propose an approach for medical image arbitrary-scale super-resolution (MIASSR), in which we couple meta-learning with generative adversarial networks (GANs) to super-resolve medical images at any scale of magnification in (1, 4]. Compared to state-of-the-art SISR algorithms on single-modal magnetic resonance (MR) brain images (OASIS-brains) and multi-modal MR brain images (BraTS), MIASSR achieves comparable fidelity performance and the best perceptual quality with the smallest model size. We also employ transfer learning to enable MIASSR to tackle SR tasks of new medical modalities, such as cardiac MR images (ACDC) and chest computed tomography images (COVID-CT). The source code of our work is also public. Thus, MIASSR has the potential to become a new foundational pre-/post-processing step in clinical image analysis tasks such as reconstruction, image quality enhancement, and segmentation.

READ FULL TEXT

page 3

page 7

page 18

page 19

research
01/23/2022

Perceptual cGAN for MRI Super-resolution

Capturing high-resolution magnetic resonance (MR) images is a time consu...
research
04/05/2020

Arbitrary Scale Super-Resolution for Brain MRI Images

Recent attempts at Super-Resolution for medical images used deep learnin...
research
11/18/2019

Multi-modal Deep Guided Filtering for Comprehensible Medical Image Processing

Deep learning-based image processing is capable of creating highly appea...
research
03/28/2023

CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolution

Medical image arbitrary-scale super-resolution (MIASSR) has recently gai...
research
10/15/2018

Lesion Focused Super-Resolution

Super-resolution (SR) for image enhancement has great importance in medi...
research
02/22/2023

A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuning

Super-resolution plays an essential role in medical imaging because it p...
research
09/06/2019

High Resolution Medical Image Analysis with Spatial Partitioning

Medical images such as 3D computerized tomography (CT) scans and patholo...

Please sign up or login with your details

Forgot password? Click here to reset