Attention-Guided Generative Adversarial Network to Address Atypical Anatomy in Modality Transfer

06/27/2020

∙

Recently, interest in MR-only treatment planning using synthetic CTs (synCTs) has grown rapidly in radiation therapy. However, developing class solutions for medical images that contain atypical anatomy remains a major limitation. In this paper, we propose a novel spatial attention-guided generative adversarial network (attention-GAN) model to generate accurate synCTs using T1-weighted MRI images as the input to address atypical anatomy. Experimental results on fifteen brain cancer patients show that attention-GAN outperformed existing synCT models and achieved an average MAE of 85.22±12.08, 232.41±60.86, 246.38±42.67 Hounsfield units between synCT and CT-SIM across the entire head, bone and air regions, respectively. Qualitative analysis shows that attention-GAN has the ability to use spatially focused areas to better handle outliers, areas with complex anatomy or post-surgical regions, and thus offer strong potential for supporting near real-time MR-only treatment planning.

READ FULL TEXT

Attention-Guided Generative Adversarial Network to Address Atypical Anatomy in Modality Transfer

Comparison of Patch-Based Conditional Generative Adversarial Neural Net Models with Emphasis on Model Robustness for Use in Head and Neck Cases for MR-Only planning

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data with Generative Adversarial Networks for Glioma Patients

Medical Image Synthesis with Context-Aware Generative Adversarial Networks

SA-GAN: Structure-Aware Generative Adversarial Network for Shape-Preserving Synthetic CT Generation

Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy

Automated Treatment Planning in Radiation Therapy using Generative Adversarial Networks

Accelerated and Quantitative 3D Semisolid MT/CEST Imaging using a Generative Adversarial Network (GAN-CEST)

Attention-Guided Generative Adversarial Network to Address Atypical Anatomy in Modality Transfer

Related Research

Comparison of Patch-Based Conditional Generative Adversarial Neural Net Models with Emphasis on Model Robustness for Use in Head and Neck Cases for MR-Only planning

Improvement of Multiparametric MR Image Segmentation by Augmenting the Data with Generative Adversarial Networks for Glioma Patients

Medical Image Synthesis with Context-Aware Generative Adversarial Networks

SA-GAN: Structure-Aware Generative Adversarial Network for Shape-Preserving Synthetic CT Generation

Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy

Automated Treatment Planning in Radiation Therapy using Generative Adversarial Networks

Accelerated and Quantitative 3D Semisolid MT/CEST Imaging using a Generative Adversarial Network (GAN-CEST)