Modality-Pairing Learning for Brain Tumor Segmentation

10/19/2020
by   Yixin Wang, et al.
0

Automatic brain tumor segmentation from multi-modality Magnetic Resonance Images (MRI) using deep learning methods plays an important role in assisting the diagnosis and treatment of brain tumor. However, previous methods mostly ignore the latent relationship among different modalities. In this work, we propose a novel end-to-end Modality-Pairing learning method for brain tumor segmentation. Paralleled branches are designed to exploit different modality features and a series of layer connections are utilized to capture complex relationships and abundant information among modalities. We also use a consistency loss to minimize the prediction variance between two branches. Besides, learning rate warmup strategy is adopted to solve the problem of the training instability and early over-fitting. Lastly, we use average ensemble of multiple models and some post-processing techniques to get final results. Our method is tested on the BraTS 2020 validation dataset, obtaining promising segmentation performance, with average dice scores of 0.908, 0.856, 0.787 for the whole tumor, tumor core and enhancing tumor, respectively. We won the second place of the BraTS 2020 Challenge for the tumor segmentation on the testing dataset.

READ FULL TEXT
research
08/16/2019

Multi-step Cascaded Networks for Brain Tumor Segmentation

Automatic brain tumor segmentation method plays an extremely important r...
research
11/08/2021

Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalities

Using multimodal Magnetic Resonance Imaging (MRI) is necessary for accur...
research
08/14/2023

Automated Ensemble-Based Segmentation of Adult Brain Tumors: A Novel Approach Using the BraTS AFRICA Challenge Data

Brain tumors, particularly glioblastoma, continue to challenge medical d...
research
02/26/2020

Region of Interest Identification for Brain Tumors in Magnetic Resonance Images

Glioma is a common type of brain tumor, and accurate detection of it pla...
research
08/26/2022

Learning Multi-Modal Brain Tumor Segmentation from Privileged Semi-Paired MRI Images with Curriculum Disentanglement Learning

Due to the difficulties of obtaining multimodal paired images in clinica...

Please sign up or login with your details

Forgot password? Click here to reset