DeepAI AI Chat
Log In Sign Up

Safety Metrics and Losses for Object Detection in Autonomous Driving

09/21/2022
by   Hsuan-Cheng Liao, et al.
Technische Universität München
0

State-of-the-art object detectors have been shown effective in many applications. Usually, their performance is evaluated based on accuracy metrics such as mean Average Precision. In this paper, we consider a safety property of 3D object detectors in the context of Autonomous Driving (AD). In particular, we propose an essential safety requirement for object detectors in AD and formulate it into a specification. During the formulation, we find that abstracting 3D objects with projected 2D bounding boxes on the image and bird's-eye-view planes allows for a necessary and sufficient condition to the proposed safety requirement. We then leverage the analysis and derive qualitative and quantitative safety metrics based on the Intersection-over-Ground-Truth measure and a distance ratio between predictions and ground truths. Finally, for continual improvement, we formulate safety losses that can be used to optimize object detectors towards higher safety scores. Our experiments with public models on the MMDetection3D library and the nuScenes datasets demonstrate the validity of our consideration and proposals.

READ FULL TEXT
03/04/2022

Safety-aware metrics for object detectors in autonomous driving

We argue that object detectors in the safety critical domain should prio...
05/21/2021

Safety Metrics for Semantic Segmentation in Autonomous Driving

Within the context of autonomous driving, safety-related metrics for dee...
12/14/2021

Revisiting 3D Object Detection From an Egocentric Perspective

3D object detection is a key module for safety-critical robotics applica...
12/22/2021

Exploring Credibility Scoring Metrics of Perception Systems for Autonomous Driving

Autonomous and semi-autonomous vehicles' perception algorithms can encou...
12/03/2020

Generalized Object Detection on Fisheye Cameras for Autonomous Driving: Dataset, Representations and Baseline

Object detection is a comprehensively studied problem in autonomous driv...
09/18/2020

Performance Monitoring of Object Detection During Deployment

Performance monitoring of object detection is crucial for safety-critica...
10/19/2020

The efficacy of Neural Planning Metrics: A meta-analysis of PKL on nuScenes

A high-performing object detection system plays a crucial role in autono...