Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalities

11/08/2021
by   Tongxue Zhou, et al.
18

Using multimodal Magnetic Resonance Imaging (MRI) is necessary for accurate brain tumor segmentation. The main problem is that not all types of MRIs are always available in clinical exams. Based on the fact that there is a strong correlation between MR modalities of the same patient, in this work, we propose a novel brain tumor segmentation network in the case of missing one or more modalities. The proposed network consists of three sub-networks: a feature-enhanced generator, a correlation constraint block and a segmentation network. The feature-enhanced generator utilizes the available modalities to generate 3D feature-enhanced image representing the missing modality. The correlation constraint block can exploit the multi-source correlation between the modalities and also constrain the generator to synthesize a feature-enhanced modality which must have a coherent correlation with the available modalities. The segmentation network is a multi-encoder based U-Net to achieve the final brain tumor segmentation. The proposed method is evaluated on BraTS 2018 dataset. Experimental results demonstrate the effectiveness of the proposed method which achieves the average Dice Score of 82.9, 74.9 and 59.1 on whole tumor, tumor core and enhancing tumor, respectively across all the situations, and outperforms the best method by 3.5

READ FULL TEXT

page 4

page 8

page 10

page 12

page 13

page 21

page 22

research
04/13/2021

Latent Correlation Representation Learning for Brain Tumor Segmentation with Missing MRI Modalities

Magnetic Resonance Imaging (MRI) is a widely used imaging technique to a...
research
03/09/2022

Multi-modal Brain Tumor Segmentation via Missing Modality Synthesis and Modality-level Attention Fusion

Multi-modal magnetic resonance (MR) imaging provides great potential for...
research
02/22/2020

Robust Multimodal Brain Tumor Segmentation via Feature Disentanglement and Gated Fusion

Accurate medical image segmentation commonly requires effective learning...
research
05/02/2020

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Magnetic Resonance (MR) images of different modalities can provide compl...
research
10/07/2019

Transfer Brain MRI Tumor Segmentation Models Across Modalities with Adversarial Networks

In this work, we present an approach to brain cancer segmentation in Mag...
research
03/19/2020

Brain tumor segmentation with missing modalities via latent multi-source correlation representation

Multimodal MR images can provide complementary information for accurate ...
research
10/19/2020

Modality-Pairing Learning for Brain Tumor Segmentation

Automatic brain tumor segmentation from multi-modality Magnetic Resonanc...

Please sign up or login with your details

Forgot password? Click here to reset