Improved Super Resolution of MR Images Using CNNs and Vision Transformers

07/24/2022
by   Dwarikanath Mahapatra, et al.
14

State of the art magnetic resonance (MR) image super-resolution methods (ISR) using convolutional neural networks (CNNs) leverage limited contextual information due to the limited spatial coverage of CNNs. Vision transformers (ViT) learn better global context that is helpful in generating superior quality HR images. We combine local information of CNNs and global information from ViTs for image super resolution and output super resolved images that have superior quality than those produced by state of the art methods. We include extra constraints through multiple novel loss functions that preserve structure and texture information from the low resolution to high resolution images.

READ FULL TEXT

page 9

page 25

page 26

page 27

page 28

research
09/25/2020

Blind Image Super-Resolution with Spatial Context Hallucination

Deep convolution neural networks (CNNs) play a critical role in single i...
research
02/22/2023

A residual dense vision transformer for medical image super-resolution with segmentation-based perceptual loss fine-tuning

Super-resolution plays an essential role in medical imaging because it p...
research
03/16/2019

Robust Super-Resolution GAN, with Manifold-based and Perception Loss

Super-resolution using deep neural networks typically relies on highly c...
research
04/12/2018

A two-stage 3D Unet framework for multi-class segmentation on full resolution image

Deep convolutional neural networks (CNNs) have been intensively used for...
research
09/10/2018

Deep MR Image Super-Resolution Using Structural Priors

High resolution magnetic resonance (MR) images are desired for accurate ...
research
10/15/2018

Channel Splitting Network for Single MR Image Super-Resolution

High resolution magnetic resonance (MR) imaging is desirable in many cli...
research
09/10/2019

Deep MR Brain Image Super-Resolution Using Spatio-Structural Priors

High resolution Magnetic Resonance (MR) images are desired for accurate ...

Please sign up or login with your details

Forgot password? Click here to reset