fRegGAN with K-space Loss Regularization for Medical Image Translation

03/28/2023
by   Ivo M. Baltruschat, et al.
0

Generative adversarial networks (GANs) have shown remarkable success in generating realistic images and are increasingly used in medical imaging for image-to-image translation tasks. However, GANs tend to suffer from a frequency bias towards low frequencies, which can lead to the removal of important structures in the generated images. To address this issue, we propose a novel frequency-aware image-to-image translation framework based on the supervised RegGAN approach, which we call fRegGAN. The framework employs a K-space loss to regularize the frequency content of the generated images and incorporates well-known properties of MRI K-space geometry to guide the network training process. By combine our method with the RegGAN approach, we can mitigate the effect of training with misaligned data and frequency bias at the same time. We evaluate our method on the public BraTS dataset and outperform the baseline methods in terms of both quantitative and qualitative metrics when synthesizing T2-weighted from T1-weighted MR images. Detailed ablation studies are provided to understand the effect of each modification on the final performance. The proposed method is a step towards improving the performance of image-to-image translation and synthesis in the medical domain and shows promise for other applications in the field of image processing and generation.

READ FULL TEXT
research
06/20/2018

Generative Adversarial Networks for Image-to-Image Translation on Multi-Contrast MR Images - A Comparison of CycleGAN and UNIT

In medical imaging, a general problem is that it is costly and time cons...
research
05/19/2020

Medical Image Generation using Generative Adversarial Networks

Generative adversarial networks (GANs) are unsupervised Deep Learning ap...
research
06/17/2018

MedGAN: Medical Image Translation using GANs

Image-to-image translation is considered a next frontier in the field of...
research
03/04/2021

A Novel Application of Image-to-Image Translation: Chromosome Straightening Framework by Learning from a Single Image

In medical imaging, chromosome straightening plays a significant role in...
research
04/23/2020

An Asymetric Cycle-Consistency Loss for Dealing with Many-to-One Mappings in Image Translation: A Study on Thigh MR Scans

Generative adversarial networks using a cycle-consistency loss facilitat...
research
09/20/2021

Deep Anomaly Generation: An Image Translation Approach of Synthesizing Abnormal Banded Chromosome Images

Advances in deep-learning-based pipelines have led to breakthroughs in a...
research
04/11/2018

Projection image-to-image translation in hybrid X-ray/MR imaging

The potential benefit of hybrid X-ray and MR imaging in the intervention...

Please sign up or login with your details

Forgot password? Click here to reset