Transformer and GAN Based Super-Resolution Reconstruction Network for Medical Images

12/26/2022
by   Weizhi Du, et al.
0

Because of the necessity to obtain high-quality images with minimal radiation doses, such as in low-field magnetic resonance imaging, super-resolution reconstruction in medical imaging has become more popular (MRI). However, due to the complexity and high aesthetic requirements of medical imaging, image super-resolution reconstruction remains a difficult challenge. In this paper, we offer a deep learning-based strategy for reconstructing medical images from low resolutions utilizing Transformer and Generative Adversarial Networks (T-GAN). The integrated system can extract more precise texture information and focus more on important locations through global image matching after successfully inserting Transformer into the generative adversarial network for picture reconstruction. Furthermore, we weighted the combination of content loss, adversarial loss, and adversarial feature loss as the final multi-task loss function during the training of our proposed model T-GAN. In comparison to established measures like PSNR and SSIM, our suggested T-GAN achieves optimal performance and recovers more texture features in super-resolution reconstruction of MRI scanned images of the knees and belly.

READ FULL TEXT

page 6

page 8

research
07/06/2019

MRI Super-Resolution with Ensemble Learning and Complementary Priors

Magnetic resonance imaging (MRI) is a widely used medical imaging modali...
research
07/10/2019

Enhanced generative adversarial network for 3D brain MRI super-resolution

Single image super-resolution (SISR) reconstruction for magnetic resonan...
research
12/29/2018

Brain MRI super-resolution using 3D generative adversarial networks

In this work we propose an adversarial learning approach to generate hig...
research
03/24/2023

A Three-Player GAN for Super-Resolution in Magnetic Resonance Imaging

Learning based single image super resolution (SISR) task is well investi...
research
06/12/2021

Task Transformer Network for Joint MRI Reconstruction and Super-Resolution

The core problem of Magnetic Resonance Imaging (MRI) is the trade off be...
research
08/16/2019

Variational Multi-Task MRI Reconstruction: Joint Reconstruction, Registration and Super-Resolution

Motion degradation is a central problem in Magnetic Resonance Imaging (M...
research
04/08/2023

Towards Realistic Ultrasound Fetal Brain Imaging Synthesis

Prenatal ultrasound imaging is the first-choice modality to assess fetal...

Please sign up or login with your details

Forgot password? Click here to reset