Quantifying and Leveraging Classification Uncertainty for Chest Radiograph Assessment

06/18/2019
by   Florin C. Ghesu, et al.
Siemens Healthineers
2

The interpretation of chest radiographs is an essential task for the detection of thoracic diseases and abnormalities. However, it is a challenging problem with high inter-rater variability and inherent ambiguity due to inconclusive evidence in the data, limited data quality or subjective definitions of disease appearance. Current deep learning solutions for chest radiograph abnormality classification are typically limited to providing probabilistic predictions, relying on the capacity of learning models to adapt to the high degree of label noise and become robust to the enumerated causal factors. In practice, however, this leads to overconfident systems with poor generalization on unseen data. To account for this, we propose an automatic system that learns not only the probabilistic estimate on the presence of an abnormality, but also an explicit uncertainty measure which captures the confidence of the system in the predicted output. We argue that explicitly learning the classification uncertainty as an orthogonal measure to the predicted output, is essential to account for the inherent variability characteristic of this data. Experiments were conducted on two datasets of chest radiographs of over 85,000 patients. Sample rejection based on the predicted uncertainty can significantly improve the ROC-AUC, e.g., by 8 0.91 with an expected rejection rate of under 25 using uncertainty-driven bootstrapping, enables a significant increase in robustness and accuracy. In addition, we present a multi-reader study showing that the predictive uncertainty is indicative of reader errors.

READ FULL TEXT
07/08/2020

Quantifying and Leveraging Predictive Uncertainty for Medical Image Assessment

The interpretation of medical images is a challenging task, often compli...
05/15/2019

Multi-task Learning for Chest X-ray Abnormality Classification on Noisy Labels

Chest X-ray (CXR) is the most common X-ray examination performed in dail...
06/02/2022

Rashomon Capacity: A Metric for Predictive Multiplicity in Probabilistic Classification

Predictive multiplicity occurs when classification models with nearly in...
03/11/2020

A variability measure for estimates of parameters in interval data fitting

The paper presents a construction of a quantitative measure of variabili...
02/09/2022

A new perspective on classification: optimally allocating limited resources to uncertain tasks

A central problem in business concerns the optimal allocation of limited...

Please sign up or login with your details

Forgot password? Click here to reset