Formal Scenario-Based Testing of Autonomous Vehicles: From Simulation to the Real World

03/17/2020
by   Daniel J. Fremont, et al.
0

We present a new approach to automated scenario-based testing of the safety of autonomous vehicles, especially those using advanced artificial intelligence-based components, spanning both simulation-based evaluation as well as testing in the real world. Our approach is based on formal methods, combining formal specification of scenarios and safety properties, algorithmic test case generation using formal simulation, test case selection for track testing, executing test cases on the track, and analyzing the resulting data. Experiments with a real autonomous vehicle at an industrial testing ground support our hypotheses that (i) formal simulation can be effective at identifying test cases to run on the track, and (ii) the gap between simulated and real worlds can be systematically evaluated and bridged.

READ FULL TEXT

page 1

page 5

page 7

research
09/06/2021

ViSTA: a Framework for Virtual Scenario-based Testing of Autonomous Vehicles

In this paper, we present ViSTA, a framework for Virtual Scenario-based ...
research
03/04/2020

Efficient statistical validation with edge cases to evaluate Highly Automated Vehicles

The widescale deployment of Autonomous Vehicles (AV) seems to be imminen...
research
08/31/2022

LawBreaker: An Approach for Specifying Traffic Laws and Fuzzing Autonomous Vehicles

Autonomous driving systems (ADSs) must be tested thoroughly before they ...
research
12/01/2021

Querying Labelled Data with Scenario Programs for Sim-to-Real Validation

Simulation-based testing of autonomous vehicles (AVs) has become an esse...
research
05/22/2019

A Method for Classifying Test Bench Configurations in a Scenario-Based Test Approach for Automated Vehicles

The introduction of automated vehicles demands a way to prove their safe...
research
05/11/2018

Quantitative Projection Coverage for Testing ML-enabled Autonomous Systems

Systematically testing models learned from neural networks remains a cru...
research
07/01/2023

A Requirements-Driven Platform for Validating Field Operations of Small Uncrewed Aerial Vehicles

Flight-time failures of small Uncrewed Aerial Systems (sUAS) can have a ...

Please sign up or login with your details

Forgot password? Click here to reset