Learn to Estimate Labels Uncertainty for Quality Assurance

09/17/2019
by   Agnieszka Tomczack, et al.
0

Deep Learning sets the state-of-the-art in many challenging tasks showing outstanding performance in a broad range of applications. Despite its success, it still lacks robustness hindering its adoption in medical applications. Modeling uncertainty, through Bayesian Inference and Monte-Carlo dropout, has been successfully introduced for better understanding the underlying deep learning models. Yet, another important source of uncertainty, coming from the inter-observer variability, has not been thoroughly addressed in the literature. In this paper, we introduce labels uncertainty which better suits medical applications and show that modeling such uncertainty together with epistemic uncertainty is of high interest for quality control and referral systems.

READ FULL TEXT
research
04/26/2021

Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imaging

The consideration of predictive uncertainty in medical imaging with deep...
research
03/22/2021

On the Robustness of Monte Carlo Dropout Trained with Noisy Labels

The memorization effect of deep learning hinders its performance to effe...
research
04/10/2020

Model Uncertainty Quantification for Reliable Deep Vision Structural Health Monitoring

Computer vision leveraging deep learning has achieved significant succes...
research
06/10/2019

Evaluating aleatoric and epistemic uncertainties of time series deep learning models for soil moisture predictions

Soil moisture is an important variable that determines floods, vegetatio...
research
04/17/2023

On Uncertainty Calibration and Selective Generation in Probabilistic Neural Summarization: A Benchmark Study

Modern deep models for summarization attains impressive benchmark perfor...
research
08/04/2020

On Feature Relevance Uncertainty: A Monte Carlo Dropout Sampling Approach

Understanding decisions made by neural networks is key for the deploymen...
research
06/07/2021

Uncertainty Baselines: Benchmarks for Uncertainty Robustness in Deep Learning

High-quality estimates of uncertainty and robustness are crucial for num...

Please sign up or login with your details

Forgot password? Click here to reset