Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentation

03/17/2023
by   Kai Ren, et al.
9

Classification and segmentation are crucial in medical image analysis as they enable accurate diagnosis and disease monitoring. However, current methods often prioritize the mutual learning features and shared model parameters, while neglecting the reliability of features and performances. In this paper, we propose a novel Uncertainty-informed Mutual Learning (UML) framework for reliable and interpretable medical image analysis. Our UML introduces reliability to joint classification and segmentation tasks, leveraging mutual learning with uncertainty to improve performance. To achieve this, we first use evidential deep learning to provide image-level and pixel-wise confidences. Then, an Uncertainty Navigator Decoder is constructed for better using mutual features and generating segmentation results. Besides, an Uncertainty Instructor is proposed to screen reliable masks for classification. Overall, UML could produce confidence estimation in features and performance for each link (classification and segmentation). The experiments on the public datasets demonstrate that our UML outperforms existing methods in terms of both accuracy and robustness. Our UML has the potential to explore the development of more reliable and explainable medical image analysis models. We will release the codes for reproduction after acceptance.

READ FULL TEXT
research
07/22/2021

Explainable artificial intelligence (XAI) in deep learning-based medical image analysis

With an increase in deep learning-based methods, the call for explainabi...
research
01/20/2022

SoftDropConnect (SDC) – Effective and Efficient Quantification of the Network Uncertainty in Deep MR Image Analysis

Recently, deep learning has achieved remarkable successes in medical ima...
research
03/16/2022

Layer Ensembles: A Single-Pass Uncertainty Estimation in Deep Learning for Segmentation

Uncertainty estimation in deep learning has become a leading research fi...
research
05/13/2023

Towards Generalizable Medical Image Segmentation with Pixel-wise Uncertainty Estimation

Deep neural networks (DNNs) achieve promising performance in visual reco...
research
01/21/2021

Analyzing Epistemic and Aleatoric Uncertainty for Drusen Segmentation in Optical Coherence Tomography Images

Age-related macular degeneration (AMD) is one of the leading causes of p...
research
07/11/2023

SAM-U: Multi-box prompts triggered uncertainty estimation for reliable SAM in medical image

Recently, Segmenting Anything has taken an important step towards genera...
research
07/17/2019

Patient-specific Conditional Joint Models of Shape, Image Features and Clinical Indicators

We propose and demonstrate a joint model of anatomical shapes, image fea...

Please sign up or login with your details

Forgot password? Click here to reset