Leveraging Uncertainty Estimates for Predicting Segmentation Quality

07/02/2018
by   Terrance DeVries, et al.
4

The use of deep learning for medical imaging has seen tremendous growth in the research community. One reason for the slow uptake of these systems in the clinical setting is that they are complex, opaque and tend to fail silently. Outside of the medical imaging domain, the machine learning community has recently proposed several techniques for quantifying model uncertainty (i.e. a model knowing when it has failed). This is important in practical settings, as we can refer such cases to manual inspection or correction by humans. In this paper, we aim to bring these recent results on estimating uncertainty to bear on two important outputs in deep learning-based segmentation. The first is producing spatial uncertainty maps, from which a clinician can observe where and why a system thinks it is failing. The second is quantifying an image-level prediction of failure, which is useful for isolating specific cases and removing them from automated pipelines. We also show that reasoning about spatial uncertainty, the first output, is a useful intermediate representation for generating segmentation quality predictions, the second output. We propose a two-stage architecture for producing these measures of uncertainty, which can accommodate any deep learning-based medical segmentation pipeline.

READ FULL TEXT

page 3

page 5

page 7

research
02/16/2023

A Review of Uncertainty Estimation and its Application in Medical Imaging

The use of AI systems in healthcare for the early screening of diseases ...
research
11/15/2021

T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical Imaging

Lesion segmentation in medical imaging has been an important topic in cl...
research
11/01/2022

Exploring Structure-Wise Uncertainty for 3D Medical Image Segmentation

When applying a Deep Learning model to medical images, it is crucial to ...
research
07/07/2019

Assessing Reliability and Challenges of Uncertainty Estimations for Medical Image Segmentation

Despite the recent improvements in overall accuracy, deep learning syste...
research
12/17/2020

Quantifying the Unknown: Impact of Segmentation Uncertainty on Image-Based Simulations

Image-based simulation, the use of 3D images to calculate physical quant...
research
05/05/2021

Impact of individual rater style on deep learning uncertainty in medical imaging segmentation

While multiple studies have explored the relation between inter-rater va...
research
09/27/2018

Towards increased trustworthiness of deep learning segmentation methods on cardiac MRI

Current state-of-the-art deep learning segmentation methods have not yet...

Please sign up or login with your details

Forgot password? Click here to reset