Local Temperature Scaling for Probability Calibration

08/12/2020
by   Zhipeng Ding, et al.
0

For semantic segmentation, label probabilities are often uncalibrated as they are typically only the by-product of a segmentation task. Intersection over Union (IoU) and Dice score are often used as criteria for segmentation success, while metrics related to label probabilities are rarely explored. On the other hand, probability calibration approaches have been studied, which aim at matching probability outputs with experimentally observed errors, but they mainly focus on classification tasks, not on semantic segmentation. Thus, we propose a learning-based calibration method that focuses on multi-label semantic segmentation. Specifically, we adopt a tree-like convolution neural network to predict local temperature values for probability calibration. One advantage of our approach is that it does not change prediction accuracy, hence allowing for calibration as a post-processing step. Experiments on the COCO and LPBA40 datasets demonstrate improved calibration performance over different metrics. We also demonstrate the performance of our method for multi-atlas brain segmentation from magnetic resonance images.

READ FULL TEXT

page 4

page 18

research
12/21/2021

Distribution-aware Margin Calibration for Semantic Segmentation in Images

The Jaccard index, also known as Intersection-over-Union (IoU), is one o...
research
12/22/2022

On Calibrating Semantic Segmentation Models: Analysis and An Algorithm

We study the problem of semantic segmentation calibration. For image cla...
research
07/20/2023

Label Calibration for Semantic Segmentation Under Domain Shift

Performance of a pre-trained semantic segmentation model is likely to su...
research
09/23/2022

Neural Clamping: Joint Input Perturbation and Temperature Scaling for Neural Network Calibration

Neural network calibration is an essential task in deep learning to ensu...
research
11/01/2019

VoteNet+ : An Improved Deep Learning Label Fusion Method for Multi-atlas Segmentation

In this work, we improve the performance of multi-atlas segmentation (MA...
research
01/21/2019

Calibration with Bias-Corrected Temperature Scaling Improves Domain Adaptation Under Label Shift in Modern Neural Networks

Label shift refers to the phenomenon where the marginal probability p(y)...
research
07/16/2023

Boundary-weighted logit consistency improves calibration of segmentation networks

Neural network prediction probabilities and accuracy are often only weak...

Please sign up or login with your details

Forgot password? Click here to reset