Multivariate Confidence Calibration for Object Detection

04/28/2020
by   Fabian Küppers, et al.
0

Unbiased confidence estimates of neural networks are crucial especially for safety-critical applications. Many methods have been developed to calibrate biased confidence estimates. Though there is a variety of methods for classification, the field of object detection has not been addressed yet. Therefore, we present a novel framework to measure and calibrate biased (or miscalibrated) confidence estimates of object detection methods. The main difference to related work in the field of classifier calibration is that we also use additional information of the regression output of an object detector for calibration. Our approach allows, for the first time, to obtain calibrated confidence estimates with respect to image location and box scale. In addition, we propose a new measure to evaluate miscalibration of object detectors. Finally, we show that our developed methods outperform state-of-the-art calibration models for the task of object detection and provides reliable confidence estimates across different locations and scales.

READ FULL TEXT

page 1

page 5

page 8

research
02/25/2022

Confidence Calibration for Object Detection and Segmentation

Calibrated confidence estimates obtained from neural networks are crucia...
research
09/21/2021

Bayesian Confidence Calibration for Epistemic Uncertainty Modelling

Modern neural networks have found to be miscalibrated in terms of confid...
research
12/03/2021

The Box Size Confidence Bias Harms Your Object Detector

Countless applications depend on accurate predictions with reliable conf...
research
01/08/2021

From Black-box to White-box: Examining Confidence Calibration under different Conditions

Confidence calibration is a major concern when applying artificial neura...
research
06/24/2023

Efficient Annotation of Medieval Charters

Diplomatics, the analysis of medieval charters, is a major field of rese...
research
06/14/2023

Multiclass Confidence and Localization Calibration for Object Detection

Albeit achieving high predictive accuracy across many challenging comput...
research
09/06/2023

Do We Still Need Non-Maximum Suppression? Accurate Confidence Estimates and Implicit Duplication Modeling with IoU-Aware Calibration

Object detectors are at the heart of many semi- and fully autonomous dec...

Please sign up or login with your details

Forgot password? Click here to reset