Uncertainty-Aware AB3DMOT by Variational 3D Object Detection

02/12/2023
by   Illia Oleksiienko, et al.
0

Autonomous driving needs to rely on high-quality 3D object detection to ensure safe navigation in the world. Uncertainty estimation is an effective tool to provide statistically accurate predictions, while the associated detection uncertainty can be used to implement a more safe navigation protocol or include the user in the loop. In this paper, we propose a Variational Neural Network-based TANet 3D object detector to generate 3D object detections with uncertainty and introduce these detections to an uncertainty-aware AB3DMOT tracker. This is done by applying a linear transformation to the estimated uncertainty matrix, which is subsequently used as a measurement noise for the adopted Kalman filter. We implement two ways to estimate output uncertainty, i.e., internally, by computing the variance of the CNNs outputs and then propagating the uncertainty through the post-processing, and externally, by associating the final predictions of different samples and computing the covariance of each predicted box. In experiments, we show that the external uncertainty estimation leads to better results, outperforming both internal uncertainty estimation and classical tracking approaches. Furthermore, we propose a method to initialize the Variational 3D object detector with a pretrained TANet model, which leads to the best performing models.

READ FULL TEXT
research
11/04/2020

Uncertainty-Aware Voxel based 3D Object Detection and Tracking with von-Mises Loss

Object detection and tracking is a key task in autonomy. Specifically, 3...
research
10/04/2021

CertainNet: Sampling-free Uncertainty Estimation for Object Detection

Estimating the uncertainty of a neural network plays a fundamental role ...
research
02/12/2023

Variational Voxel Pseudo Image Tracking

Uncertainty estimation is an important task for critical problems, such ...
research
06/13/2023

LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Clouds

Object detection on Lidar point cloud data is a promising technology for...
research
06/01/2022

LiDAR-MIMO: Efficient Uncertainty Estimation for LiDAR-based 3D Object Detection

The estimation of uncertainty in robotic vision, such as 3D object detec...
research
03/01/2020

MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationships

Monocular 3D object detection is an essential component in autonomous dr...
research
10/06/2022

A Review of Uncertainty Calibration in Pretrained Object Detectors

In the field of deep learning based computer vision, the development of ...

Please sign up or login with your details

Forgot password? Click here to reset