DOMINO: Domain-aware Model Calibration in Medical Image Segmentation

09/13/2022
by   Skylar E. Stolte, et al.
9

Model calibration measures the agreement between the predicted probability estimates and the true correctness likelihood. Proper model calibration is vital for high-risk applications. Unfortunately, modern deep neural networks are poorly calibrated, compromising trustworthiness and reliability. Medical image segmentation particularly suffers from this due to the natural uncertainty of tissue boundaries. This is exasperated by their loss functions, which favor overconfidence in the majority classes. We address these challenges with DOMINO, a domain-aware model calibration method that leverages the semantic confusability and hierarchical similarity between class labels. Our experiments demonstrate that our DOMINO-calibrated deep neural networks outperform non-calibrated models and state-of-the-art morphometric methods in head image segmentation. Our results show that our method can consistently achieve better calibration, higher accuracy, and faster inference times than these methods, especially on rarer classes. This performance is attributed to our domain-aware regularization to inform semantic model calibration. These findings show the importance of semantic ties between class labels in building confidence in deep learning models. The framework has the potential to improve the trustworthiness and reliability of generic medical image segmentation models. The code for this article is available at: https://github.com/lab-smile/DOMINO.

READ FULL TEXT

page 7

page 8

page 11

page 12

research
11/29/2019

Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentation

Fully convolutional neural networks (FCNs), and in particular U-Nets, ha...
research
02/10/2023

DOMINO: Domain-aware Loss for Deep Learning Calibration

Deep learning has achieved the state-of-the-art performance across medic...
research
12/22/2021

Maximum Entropy on Erroneous Predictions (MEEP): Improving model calibration for medical image segmentation

Modern deep neural networks have achieved remarkable progress in medical...
research
12/23/2021

On the relationship between calibrated predictors and unbiased volume estimation

Machine learning driven medical image segmentation has become standard i...
research
08/21/2023

DOMINO++: Domain-aware Loss Regularization for Deep Learning Generalizability

Out-of-distribution (OOD) generalization poses a serious challenge for m...
research
08/02/2023

Calibration in Deep Learning: A Survey of the State-of-the-Art

Calibrating deep neural models plays an important role in building relia...
research
11/03/2020

Distribution-aware Margin Calibration for Medical Image Segmentation

The Jaccard index, also known as Intersection-over-Union (IoU score), is...

Please sign up or login with your details

Forgot password? Click here to reset