DS3-Net: Difficulty-perceived Common-to-T1ce Semi-Supervised Multimodal MRI Synthesis Network

03/14/2022
by   Ziqi Huang, et al.
13

Contrast-enhanced T1 (T1ce) is one of the most essential magnetic resonance imaging (MRI) modalities for diagnosing and analyzing brain tumors, especially gliomas. In clinical practice, common MRI modalities such as T1, T2, and fluid attenuation inversion recovery are relatively easy to access while T1ce is more challenging considering the additional cost and potential risk of allergies to the contrast agent. Therefore, it is of great clinical necessity to develop a method to synthesize T1ce from other common modalities. Current paired image translation methods typically have the issue of requiring a large amount of paired data and do not focus on specific regions of interest, e.g., the tumor region, in the synthesization process. To address these issues, we propose a Difficulty-perceived common-to-T1ce Semi-Supervised multimodal MRI Synthesis network (DS3-Net), involving both paired and unpaired data together with dual-level knowledge distillation. DS3-Net predicts a difficulty map to progressively promote the synthesis task. Specifically, a pixelwise constraint and a patchwise contrastive constraint are guided by the predicted difficulty map. Through extensive experiments on the publiclyavailable BraTS2020 dataset, DS3-Net outperforms its supervised counterpart in each respect. Furthermore, with only 5 with state-of-theart image translation methods utilizing 100 delivering an average SSIM of 0.8947 and an average PSNR of 23.60.

READ FULL TEXT
research
12/09/2019

Semi-supervised Learning Approach to Generate Neuroimaging Modalities with Adversarial Training

Magnetic Resonance Imaging (MRI) of the brain can come in the form of di...
research
03/09/2023

M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalities

Multimodal magnetic resonance imaging (MRI) provides complementary infor...
research
06/23/2023

A Semi-Paired Approach For Label-to-Image Translation

Data efficiency, or the ability to generalize from a few labeled data, r...
research
04/04/2021

Contrast-enhanced MRI Synthesis Using 3D High-Resolution ConvNets

Gadolinium-based contrast agents (GBCAs) have been widely used to better...
research
01/14/2021

A Unified Conditional Disentanglement Framework for Multimodal Brain MR Image Translation

Multimodal MRI provides complementary and clinically relevant informatio...
research
12/17/2018

Semi-supervised mp-MRI Data Synthesis with StitchLayer and Auxiliary Distance Maximization

In this paper, we address the problem of synthesizing multi-parameter ma...

Please sign up or login with your details

Forgot password? Click here to reset