Uncertainty Quantification in Computer-Aided Diagnosis: Make Your Model say "I don't know" for Ambiguous Cases

08/02/2019
by   Max-Heinrich Laves, et al.
0

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to get a posterior distribution of the class labels (Bayesian ResNet). The second method extends ResNet to a probabilistic approach by predicting the parameters of the posterior distribution and sampling the final result from it (Variational ResNet).The variance of the posterior is used as metric for uncertainty.Both methods are trained on a data set of optical coherence tomography scans showing four different retinal conditions. Our results shown that cases in which the classifier predicts incorrectly correlate with a higher uncertainty. Mean uncertainty of incorrectly diagnosed cases was between 4.6 and 8.1 times higher than mean uncertainty of correctly diagnosed cases. Modeling of the prediction uncertainty in computer-aided diagnosis with deep learning yields more reliable results and is anticipated to increase patient safety.

READ FULL TEXT
research
01/26/2021

Uncertainty aware and explainable diagnosis of retinal disease

Deep learning methods for ophthalmic diagnosis have shown considerable s...
research
11/11/2018

Langevin-gradient parallel tempering for Bayesian neural learning

Bayesian neural learning feature a rigorous approach to estimation and u...
research
08/17/2021

Incorporating Uncertainty in Learning to Defer Algorithms for Safe Computer-Aided Diagnosis

In this study we propose the Learning to Defer with Uncertainty (LDU) al...
research
10/23/2019

We Know Where We Don't Know: 3D Bayesian CNNs for Uncertainty Quantification of Binary Segmentations for Material Simulations

Deep learning has been applied with great success to the segmentation of...
research
04/10/2020

Model Uncertainty Quantification for Reliable Deep Vision Structural Health Monitoring

Computer vision leveraging deep learning has achieved significant succes...
research
07/03/2023

Robust Uncertainty Estimation for Classification of Maritime Objects

We explore the use of uncertainty estimation in the maritime domain, sho...
research
06/25/2021

Scene Uncertainty and the Wellington Posterior of Deterministic Image Classifiers

We propose a method to estimate the uncertainty of the outcome of an ima...

Please sign up or login with your details

Forgot password? Click here to reset