DeepAI
Log In Sign Up

SOUP-GAN: Super-Resolution MRI Using Generative Adversarial Networks

06/04/2021
by   Kuan Zhang, et al.
20

There is a growing demand for high-resolution (HR) medical images in both the clinical and research applications. Image quality is inevitably traded off with the acquisition time for better patient comfort, lower examination costs, dose, and fewer motion-induced artifacts. For many image-based tasks, increasing the apparent resolution in the perpendicular plane to produce multi-planar reformats or 3D images is commonly used. Single image super-resolution (SR) is a promising technique to provide HR images based on unsupervised learning to increase resolution of a 2D image, but there are few reports on 3D SR. Further, perceptual loss is proposed in the literature to better capture the textual details and edges than using pixel-wise loss functions, by comparing the semantic distances in the high-dimensional feature space of a pre-trained 2D network (e.g., VGG). However, it is not clear how one should generalize it to 3D medical images, and the attendant implications are still unclear. In this paper, we propose a framework called SOUP-GAN: Super-resolution Optimized Using Perceptual-tuned Generative Adversarial Network (GAN), in order to produce thinner slice (e.g., high resolution in the 'Z' plane) medical images with anti-aliasing and deblurring. The proposed method outperforms other conventional resolution-enhancement methods and previous SR work on medical images upon both qualitative and quantitative comparisons. Specifically, we examine the model in terms of its generalization for various SR ratios and imaging modalities. By addressing those limitations, our model shows promise as a novel 3D SR interpolation technique, providing potential applications in both clinical and research settings.

READ FULL TEXT

page 1

page 3

page 5

page 7

page 8

page 9

01/10/2019

How Can We Make GAN Perform Better in Single Medical Image Super-Resolution? A Lesion Focused Multi-Scale Approach

Single image super-resolution (SISR) is of great importance as a low-lev...
10/11/2022

DA-VSR: Domain Adaptable Volumetric Super-Resolution For Medical Images

Medical image super-resolution (SR) is an active research area that has ...
11/22/2022

SRTGAN: Triplet Loss based Generative Adversarial Network for Real-World Super-Resolution

Many applications such as forensics, surveillance, satellite imaging, me...
10/22/2021

Multimodal-Boost: Multimodal Medical Image Super-Resolution using Multi-Attention Network with Wavelet Transform

Multimodal medical images are widely used by clinicians and physicians t...
10/15/2018

Lesion Focused Super-Resolution

Super-resolution (SR) for image enhancement has great importance in medi...
12/30/2021

A Resolution Enhancement Plug-in for Deformable Registration of Medical Images

Image registration is a fundamental task for medical imaging. Resampling...

Code Repositories