DeepAI AI Chat
Log In Sign Up

Interaction-Dynamics-Aware Perception Zones for Obstacle Detection Safety Evaluation

by   Sever Topan, et al.

To enable safe autonomous vehicle (AV) operations, it is critical that an AV's obstacle detection module can reliably detect obstacles that pose a safety threat (i.e., are safety-critical). It is therefore desirable that the evaluation metric for the perception system captures the safety-criticality of objects. Unfortunately, existing perception evaluation metrics tend to make strong assumptions about the objects and ignore the dynamic interactions between agents, and thus do not accurately capture the safety risks in reality. To address these shortcomings, we introduce an interaction-dynamics-aware obstacle detection evaluation metric by accounting for closed-loop dynamic interactions between an ego vehicle and obstacles in the scene. By borrowing existing theory from optimal control theory, namely Hamilton-Jacobi reachability, we present a computationally tractable method for constructing a “safety zone”: a region in state space that defines where safety-critical obstacles lie for the purpose of defining safety metrics. Our proposed safety zone is mathematically complete, and can be easily computed to reflect a variety of safety requirements. Using an off-the-shelf detection algorithm from the nuScenes detection challenge leaderboard, we demonstrate that our approach is computationally lightweight, and can better capture safety-critical perception errors than a baseline approach.


page 1

page 5

page 9


Verifiable Obstacle Detection

Perception of obstacles remains a critical safety concern for autonomous...

Safe and Robust Motion Planning for Dynamic Robotics via Control Barrier Functions

Control Barrier Functions (CBF) are widely used to enforce the safety-cr...

Injecting Planning-Awareness into Prediction and Detection Evaluation

Detecting other agents and forecasting their behavior is an integral par...

Tackling Occlusions & Limited Sensor Range with Set-based Safety Verification

Provable safety is one of the most critical challenges in automated driv...

Sensor Visibility Estimation: Metrics and Methods for Systematic Performance Evaluation and Improvement

Sensor visibility is crucial for safety-critical applications in automot...

Risk-Driven Design of Perception Systems

Modern autonomous systems rely on perception modules to process complex ...