Uncertainty Estimation based on Geometric Separation

01/11/2023
by   Gabriella Chouraqui, et al.
0

In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical applications such as autonomous driving. In this work, we put forward a novel geometric-based approach for improving uncertainty estimations in machine learning models. Our approach involves using the geometric distance of the current input from existing training inputs as a signal for estimating uncertainty, and then calibrating this signal using standard post-hoc techniques. We demonstrate that our method leads to more accurate uncertainty estimations than recently proposed approaches through extensive evaluation on a variety of datasets and models. Additionally, we optimize our approach so that it can be implemented on large datasets in near real-time applications, making it suitable for time-sensitive scenarios.

READ FULL TEXT

page 17

page 18

research
06/23/2022

A Geometric Method for Improved Uncertainty Estimation in Real-time

Machine learning classifiers are probabilistic in nature, and thus inevi...
research
10/06/2021

Post-hoc Models for Performance Estimation of Machine Learning Inference

Estimating how well a machine learning model performs during inference i...
research
05/10/2022

Knowledge Augmented Machine Learning with Applications in Autonomous Driving: A Survey

The existence of representative datasets is a prerequisite of many succe...
research
09/03/2017

Uncertainty-Aware Learning from Demonstration using Mixture Density Networks with Sampling-Free Variance Modeling

In this paper, we propose an uncertainty-aware learning from demonstrati...
research
07/15/2021

Adversarial Attack for Uncertainty Estimation: Identifying Critical Regions in Neural Networks

We propose a novel method to capture data points near decision boundary ...
research
10/28/2022

Measuring the Confidence of Traffic Forecasting Models: Techniques, Experimental Comparison and Guidelines towards Their Actionability

The estimation of the amount of uncertainty featured by predictive machi...
research
03/24/2023

LINe: Out-of-Distribution Detection by Leveraging Important Neurons

It is important to quantify the uncertainty of input samples, especially...

Please sign up or login with your details

Forgot password? Click here to reset