Overcoming the Limitations of Localization Uncertainty: Efficient Exact Non-Linear Post-Processing and Calibration

06/15/2023
by   Moussa Kassem Sbeyti, et al.
0

Robustly and accurately localizing objects in real-world environments can be challenging due to noisy data, hardware limitations, and the inherent randomness of physical systems. To account for these factors, existing works estimate the aleatoric uncertainty of object detectors by modeling their localization output as a Gaussian distribution 𝒩(μ, σ^2), and training with loss attenuation. We identify three aspects that are unaddressed in the state of the art, but warrant further exploration: (1) the efficient and mathematically sound propagation of 𝒩(μ, σ^2) through non-linear post-processing, (2) the calibration of the predicted uncertainty, and (3) its interpretation. We overcome these limitations by: (1) implementing loss attenuation in EfficientDet, and proposing two deterministic methods for the exact and fast propagation of the output distribution, (2) demonstrating on the KITTI and BDD100K datasets that the predicted uncertainty is miscalibrated, and adapting two calibration methods to the localization task, and (3) investigating the correlation between aleatoric uncertainty and task-relevant error sources. Our contributions are: (1) up to five times faster propagation while increasing localization performance by up to 1%, (2) up to fifteen times smaller expected calibration error, and (3) the predicted uncertainty is found to correlate with occlusion, object distance, detection accuracy, and image quality.

READ FULL TEXT
research
05/26/2020

Improving Regression Uncertainty Estimates with an Empirical Prior

While machine learning models capable of producing uncertainty estimates...
research
02/06/2023

Uncertainty Calibration and its Application to Object Detection

Image-based environment perception is an important component especially ...
research
03/26/2018

Calibrated Prediction Intervals for Neural Network Regressors

Ongoing developments in neural network models are continually advancing ...
research
09/23/2020

Robust and efficient post-processing for video object detection

Object recognition in video is an important task for plenty of applicati...
research
10/06/2022

A Review of Uncertainty Calibration in Pretrained Object Detectors

In the field of deep learning based computer vision, the development of ...
research
07/04/2022

Parametric and Multivariate Uncertainty Calibration for Regression and Object Detection

Reliable spatial uncertainty evaluation of object detection models is of...
research
09/20/2021

Modeling Annotation Uncertainty with Gaussian Heatmaps in Landmark Localization

In landmark localization, due to ambiguities in defining their exact pos...

Please sign up or login with your details

Forgot password? Click here to reset