Edge-aware Multi-task Network for Integrating Quantification Segmentation and Uncertainty Prediction of Liver Tumor on Multi-modality Non-contrast MRI

07/04/2023
by   Xiaojiao Xiao, et al.
0

Simultaneous multi-index quantification, segmentation, and uncertainty estimation of liver tumors on multi-modality non-contrast magnetic resonance imaging (NCMRI) are crucial for accurate diagnosis. However, existing methods lack an effective mechanism for multi-modality NCMRI fusion and accurate boundary information capture, making these tasks challenging. To address these issues, this paper proposes a unified framework, namely edge-aware multi-task network (EaMtNet), to associate multi-index quantification, segmentation, and uncertainty of liver tumors on the multi-modality NCMRI. The EaMtNet employs two parallel CNN encoders and the Sobel filters to extract local features and edge maps, respectively. The newly designed edge-aware feature aggregation module (EaFA) is used for feature fusion and selection, making the network edge-aware by capturing long-range dependency between feature and edge maps. Multi-tasking leverages prediction discrepancy to estimate uncertainty and improve segmentation and quantification performance. Extensive experiments are performed on multi-modality NCMRI with 250 clinical subjects. The proposed model outperforms the state-of-the-art by a large margin, achieving a dice similarity coefficient of 90.01±1.23 and a mean absolute error of 2.72±0.58 mm for MD. The results demonstrate the potential of EaMtNet as a reliable clinical-aided tool for medical image analysis.

READ FULL TEXT
research
01/07/2022

United adversarial learning for liver tumor segmentation and detection of multi-modality non-contrast MRI

Simultaneous segmentation and detection of liver tumors (hemangioma and ...
research
11/16/2022

Uncertainty-Aware Multi-Parametric Magnetic Resonance Image Information Fusion for 3D Object Segmentation

Multi-parametric magnetic resonance (MR) imaging is an indispensable too...
research
07/15/2022

CKD-TransBTS: Clinical Knowledge-Driven Hybrid Transformer with Modality-Correlated Cross-Attention for Brain Tumor Segmentation

Brain tumor segmentation (BTS) in magnetic resonance image (MRI) is cruc...
research
08/02/2023

FusionAD: Multi-modality Fusion for Prediction and Planning Tasks of Autonomous Driving

Building a multi-modality multi-task neural network toward accurate and ...
research
03/01/2017

Perturb-and-MPM: Quantifying Segmentation Uncertainty in Dense Multi-Label CRFs

This paper proposes a novel approach for uncertainty quantification in d...
research
07/10/2023

K-Space-Aware Cross-Modality Score for Synthesized Neuroimage Quality Assessment

The problem of how to assess cross-modality medical image synthesis has ...
research
04/10/2016

DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation

The morphology of glands has been used routinely by pathologists to asse...

Please sign up or login with your details

Forgot password? Click here to reset