A Benchmark for Out of Distribution Detection in Point Cloud 3D Semantic Segmentation

11/11/2022
by   Matias Valdenegro-Toro, et al.
0

Safety-critical applications like autonomous driving use Deep Neural Networks (DNNs) for object detection and segmentation. The DNNs fail to predict when they observe an Out-of-Distribution (OOD) input leading to catastrophic consequences. Existing OOD detection methods were extensively studied for image inputs but have not been explored much for LiDAR inputs. So in this study, we proposed two datasets for benchmarking OOD detection in 3D semantic segmentation. We used Maximum Softmax Probability and Entropy scores generated using Deep Ensembles and Flipout versions of RandLA-Net as OOD scores. We observed that Deep Ensembles out perform Flipout model in OOD detection with greater AUROC scores for both datasets.

READ FULL TEXT

page 4

page 8

page 9

page 10

page 11

research
09/28/2022

Out-of-Distribution Detection for LiDAR-based 3D Object Detection

3D object detection is an essential part of automated driving, and deep ...
research
12/09/2020

Entropy Maximization and Meta Classification for Out-Of-Distribution Detection in Semantic Segmentation

Deep neural networks (DNNs) for the semantic segmentation of images are ...
research
01/03/2023

Benchmarking the Robustness of LiDAR Semantic Segmentation Models

When using LiDAR semantic segmentation models for safety-critical applic...
research
09/02/2020

On the Structures of Representation for the Robustness of Semantic Segmentation to Input Corruption

Semantic segmentation is a scene understanding task at the heart of safe...
research
09/02/2019

This is not what I imagined: Error Detection for Semantic Segmentation through Visual Dissimilarity

There has been a remarkable progress in the accuracy of semantic segment...
research
08/03/2023

Assessing Systematic Weaknesses of DNNs using Counterfactuals

With the advancement of DNNs into safety-critical applications, testing ...
research
12/11/2021

Attacking Point Cloud Segmentation with Color-only Perturbation

Recent research efforts on 3D point-cloud semantic segmentation have ach...

Please sign up or login with your details

Forgot password? Click here to reset