Conformalized Multimodal Uncertainty Regression and Reasoning

09/20/2023
by   Domenico Parente, et al.
0

This paper introduces a lightweight uncertainty estimator capable of predicting multimodal (disjoint) uncertainty bounds by integrating conformal prediction with a deep-learning regressor. We specifically discuss its application for visual odometry (VO), where environmental features such as flying domain symmetries and sensor measurements under ambiguities and occlusion can result in multimodal uncertainties. Our simulation results show that uncertainty estimates in our framework adapt sample-wise against challenging operating conditions such as pronounced noise, limited training data, and limited parametric size of the prediction model. We also develop a reasoning framework that leverages these robust uncertainty estimates and incorporates optical flow-based reasoning to improve prediction prediction accuracy. Thus, by appropriately accounting for predictive uncertainties of data-driven learning and closing their estimation loop via rule-based reasoning, our methodology consistently surpasses conventional deep learning approaches on all these challenging scenarios–pronounced noise, limited training data, and limited model size-reducing the prediction error by 2-3x.

READ FULL TEXT

page 1

page 2

page 4

research
03/03/2023

Lightweight, Uncertainty-Aware Conformalized Visual Odometry

Data-driven visual odometry (VO) is a critical subroutine for autonomous...
research
09/29/2022

Evaluation of physics constrained data-driven methods for turbulence model uncertainty quantification

In order to achieve a virtual certification process and robust designs f...
research
10/14/2020

A Heteroscedastic Likelihood Model for Two-frame Optical Flow

Machine vision is an important sensing technology used in mobile robotic...
research
05/13/2018

Spatial Uncertainty Sampling for End-to-End Control

End-to-end trained neural networks (NNs) are a compelling approach to au...
research
05/07/2018

Learning Optical Flow via Dilated Networks and Occlusion Reasoning

Despite the significant progress that has been made on estimating optica...
research
09/18/2023

Mutual Information-calibrated Conformal Feature Fusion for Uncertainty-Aware Multimodal 3D Object Detection at the Edge

In the expanding landscape of AI-enabled robotics, robust quantification...
research
08/18/2022

Pixel-Wise Prediction based Visual Odometry via Uncertainty Estimation

This paper introduces pixel-wise prediction based visual odometry (PWVO)...

Please sign up or login with your details

Forgot password? Click here to reset