Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

06/26/2020
by   Pengfei Guo, et al.
11

Data-driven automatic approaches have demonstrated their great potential in resolving various clinical diagnostic dilemmas for patients with malignant gliomas in neuro-oncology with the help of conventional and advanced molecular MR images. However, the lack of sufficient annotated MRI data has vastly impeded the development of such automatic methods. Conventional data augmentation approaches, including flipping, scaling, rotation, and distortion are not capable of generating data with diverse image content. In this paper, we propose a generative adversarial network (GAN), which can simultaneously synthesize data from arbitrary manipulated lesion information on multiple anatomic and molecular MRI sequences, including T1-weighted (T1w), gadolinium enhanced T1w (Gd-T1w), T2-weighted (T2w), fluid-attenuated inversion recovery (FLAIR), and amide proton transfer-weighted (APTw). The proposed framework consists of a stretch-out up-sampling module, a brain atlas encoder, a segmentation consistency module, and multi-scale labelwise discriminators. Extensive experiments on real clinical data demonstrate that the proposed model can perform significantly better than the state-of-the-art synthesis methods.

READ FULL TEXT

page 3

page 6

research
12/10/2019

DR-GAN: Conditional Generative Adversarial Network for Fine-Grained Lesion Synthesis on Diabetic Retinopathy Images

Diabetic retinopathy (DR) is a complication of diabetes that severely af...
research
07/21/2023

UWAT-GAN: Fundus Fluorescein Angiography Synthesis via Ultra-wide-angle Transformation Multi-scale GAN

Fundus photography is an essential examination for clinical and differen...
research
04/17/2023

Two-stage MR Image Segmentation Method for Brain Tumors based on Attention Mechanism

Multimodal magnetic resonance imaging (MRI) can reveal different pattern...
research
06/12/2018

Enhancing clinical MRI Perfusion maps with data-driven maps of complementary nature for lesion outcome prediction

Stroke is the second most common cause of death in developed countries, ...
research
08/05/2022

Brain Lesion Synthesis via Progressive Adversarial Variational Auto-Encoder

Laser interstitial thermal therapy (LITT) is a novel minimally invasive ...

Please sign up or login with your details

Forgot password? Click here to reset