Towards safe deep learning: accurately quantifying biomarker uncertainty in neural network predictions

06/22/2018
by   Zach Eaton-Rosen, et al.
0

Automated medical image segmentation, specifically using deep learning, has shown outstanding performance in semantic segmentation tasks. However, these methods rarely quantify their uncertainty, which may lead to errors in downstream analysis. In this work we propose to use Bayesian neural networks to quantify uncertainty within the domain of semantic segmentation. We also propose a method to convert voxel-wise segmentation uncertainty into volumetric uncertainty, and calibrate the accuracy and reliability of confidence intervals of derived measurements. When applied to a tumour volume estimation application, we demonstrate that by using such modelling of uncertainty, deep learning systems can be made to report volume estimates with well-calibrated error-bars, making them safer for clinical use. We also show that the uncertainty estimates extrapolate to unseen data, and that the confidence intervals are robust in the presence of artificial noise. This could be used to provide a form of quality control and quality assurance, and may permit further adoption of deep learning tools in the clinic.

READ FULL TEXT
research
07/07/2019

Assessing Reliability and Challenges of Uncertainty Estimations for Medical Image Segmentation

Despite the recent improvements in overall accuracy, deep learning syste...
research
12/03/2018

Knowing what you know in brain segmentation using deep neural networks

In this paper, we describe a deep neural network trained to predict Free...
research
06/19/2023

Accelerated, physics-inspired inference of skeletal muscle microstructure from diffusion-weighted MRI

Muscle health is a critical component of overall health and quality of l...
research
07/20/2023

Confidence intervals for performance estimates in 3D medical image segmentation

Medical segmentation models are evaluated empirically. As such an evalua...
research
05/12/2021

Learning Uncertainty with Artificial Neural Networks for Improved Remaining Time Prediction of Business Processes

Artificial neural networks will always make a prediction, even when comp...
research
10/26/2022

How precise are performance estimates for typical medical image segmentation tasks?

An important issue in medical image processing is to be able to estimate...

Please sign up or login with your details

Forgot password? Click here to reset