A Unified Conditional Disentanglement Framework for Multimodal Brain MR Image Translation

01/14/2021
by   Xiaofeng Liu, et al.
0

Multimodal MRI provides complementary and clinically relevant information to probe tissue condition and to characterize various diseases. However, it is often difficult to acquire sufficiently many modalities from the same subject due to limitations in study plans, while quantitative analysis is still demanded. In this work, we propose a unified conditional disentanglement framework to synthesize any arbitrary modality from an input modality. Our framework hinges on a cycle-constrained conditional adversarial training approach, where it can extract a modality-invariant anatomical feature with a modality-agnostic encoder and generate a target modality with a conditioned decoder. We validate our framework on four MRI modalities, including T1-weighted, T1 contrast enhanced, T2-weighted, and FLAIR MRI, from the BraTS'18 database, showing superior performance on synthesis quality over the comparison methods. In addition, we report results from experiments on a tumor segmentation task carried out with synthesized data.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

07/08/2019

Unified Attentional Generative Adversarial Network for Brain Tumor Segmentation From Multimodal Unpaired Images

In medical applications, the same anatomical structures may be observed ...
08/28/2020

Soft Tissue Sarcoma Co-Segmentation in Combined MRI and PET/CT Data

Tumor segmentation in multimodal medical images has seen a growing trend...
01/22/2018

MRI Image-to-Image Translation for Cross-Modality Image Registration and Segmentation

We develop a novel cross-modality generation framework that learns to ge...
10/07/2019

Transfer Brain MRI Tumor Segmentation Models Across Modalities with Adversarial Networks

In this work, we present an approach to brain cancer segmentation in Mag...
12/08/2021

Unimodal Face Classification with Multimodal Training

Face recognition is a crucial task in various multimedia applications su...
07/19/2020

Unified cross-modality feature disentangler for unsupervised multi-domain MRI abdomen organs segmentation

Our contribution is a unified cross-modality feature disentagling approa...
01/07/2022

United adversarial learning for liver tumor segmentation and detection of multi-modality non-contrast MRI

Simultaneous segmentation and detection of liver tumors (hemangioma and ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.