Scalable Autonomous Vehicle Safety Validation through Dynamic Programming and Scene Decomposition

04/14/2020
by   Anthony Corso, et al.
0

An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other techniques are designed to only discover a single failure. In this work, we present a new safety validation approach that attempts to estimate the distribution over failures of an autonomous policy using approximate dynamic programming. Knowledge of this distribution allows for the efficient discovery of many failure examples. To address the problem of scalability, we decompose complex driving scenarios into subproblems consisting of only the ego vehicle and one other vehicle. These subproblems can be solved with approximate dynamic programming and their solutions are recombined to approximate the solution to the full scenario. We apply our approach to a simple two-vehicle scenario to demonstrate the technique as well as a more complex five-vehicle scenario to demonstrate scalability. In both experiments, we observed an order of magnitude increase in the number of failures discovered compared to baseline approaches.

READ FULL TEXT
research
04/14/2020

Interpretable Safety Validation for Autonomous Vehicles

An open problem for autonomous driving is how to validate the safety of ...
research
05/17/2023

Model-based Validation as Probabilistic Inference

Estimating the distribution over failures is a key step in validating au...
research
08/28/2023

ReMAV: Reward Modeling of Autonomous Vehicles for Finding Likely Failure Events

Autonomous vehicles are advanced driving systems that are well known for...
research
04/12/2018

Robust Safety for Autonomous Vehicles through Reconfigurable Networking

Autonomous vehicles bring the promise of enhancing the consumer experien...
research
12/08/2019

Efficient Black-box Assessment of Autonomous Vehicle Safety

While autonomous vehicle (AV) technology has shown substantial progress,...
research
07/14/2023

BehAVExplor: Behavior Diversity Guided Testing for Autonomous Driving Systems

Testing Autonomous Driving Systems (ADSs) is a critical task for ensurin...
research
12/01/2021

Querying Labelled Data with Scenario Programs for Sim-to-Real Validation

Simulation-based testing of autonomous vehicles (AVs) has become an esse...

Please sign up or login with your details

Forgot password? Click here to reset