Task-Aware Risk Estimation of Perception Failures for Autonomous Vehicles

05/03/2023
by   Pasquale Antonante, et al.
0

Safety and performance are key enablers for autonomous driving: on the one hand we want our autonomous vehicles (AVs) to be safe, while at the same time their performance (e.g., comfort or progression) is key to adoption. To effectively walk the tight-rope between safety and performance, AVs need to be risk-averse, but not entirely risk-avoidant. To facilitate safe-yet-performant driving, in this paper, we develop a task-aware risk estimator that assesses the risk a perception failure poses to the AV's motion plan. If the failure has no bearing on the safety of the AV's motion plan, then regardless of how egregious the perception failure is, our task-aware risk estimator considers the failure to have a low risk; on the other hand, if a seemingly benign perception failure severely impacts the motion plan, then our estimator considers it to have a high risk. In this paper, we propose a task-aware risk estimator to decide whether a safety maneuver needs to be triggered. To estimate the task-aware risk, first, we leverage the perception failure - detected by a perception monitor - to synthesize an alternative plausible model for the vehicle's surroundings. The risk due to the perception failure is then formalized as the "relative" risk to the AV's motion plan between the perceived and the alternative plausible scenario. We employ a statistical tool called copula, which models tail dependencies between distributions, to estimate this risk. The theoretical properties of the copula allow us to compute probably approximately correct (PAC) estimates of the risk. We evaluate our task-aware risk estimator using NuPlan and compare it with established baselines, showing that the proposed risk estimator achieves the best F1-score (doubling the score of the best baseline) and exhibits a good balance between recall and precision, i.e., a good balance of safety and performance.

READ FULL TEXT

page 1

page 2

page 7

page 10

research
05/21/2019

Towards Safety-Aware Computing System Design in Autonomous Vehicles

Recently, autonomous driving development ignited competition among car m...
research
10/20/2021

Exploring the Relationship Between "Positive Risk Balance" and "Absence of Unreasonable Risk"

International discussions on the overarching topic of how to define and ...
research
07/21/2021

Risk-Based Safety Envelopes for Autonomous Vehicles Under Perception Uncertainty

Ensuring the safety of autonomous vehicles, given the uncertainty in sen...
research
05/17/2021

Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception

Autonomous vehicles interacting with other traffic participants heavily ...
research
04/23/2019

Risk Structures: Towards Engineering Risk-aware Autonomous Systems

Inspired by widely-used techniques of causal modelling in risk, failure,...
research
10/06/2019

Risk-Aware Reasoning for Autonomous Vehicles

A significant barrier to deploying autonomous vehicles (AVs) on a massiv...
research
11/24/2021

Fault-Tolerant Perception for Automated Driving A Lightweight Monitoring Approach

While the most visible part of the safety verification process of automa...

Please sign up or login with your details

Forgot password? Click here to reset