A Language for Autonomous Vehicles Testing Oracles

06/17/2020
by   Ana Nora Evans, et al.
0

Testing autonomous vehicles (AVs) requires complex oracles to determine if the AVs behavior conforms with specifications and humans' expectations. Available open source oracles are tightly embedded in the AV simulation software and are developed and implemented in an ad hoc way. We propose a domain specific language that enables defining oracles independent of the AV solutions and the simulator. A testing analyst can encode safety, liveness, timeliness and temporal properties in our language. To show the expressiveness of our language we implement three different types of available oracles. We find that the same AV solutions may be ranked significantly differently across existing oracles, thus existing oracles do not evaluate AVs in a consistent manner.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

03/26/2019

A Tutorial on Sim-ATAV: Simulation-based Adversarial Testing Framework for Autonomous Vehicles

Testing autonomous vehicles in simulation environments is crucial. Sim-A...
09/11/2019

Towards Assume-Guarantee Profiles for Autonomous Vehicles

Rules or specifications for autonomous vehicles are currently formulated...
08/19/2019

Assessing the Safety and Reliability of Autonomous Vehicles from Road Testing

There is an urgent societal need to assess whether autonomous vehicles (...
11/23/2021

VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehicles

Simulation has the potential to transform the development of robust algo...
03/02/2018

Dolphin: a task orchestration language for autonomous vehicle networks

We present Dolphin, an extensible programming language for autonomous ve...
04/17/2021

GzScenic: Automatic Scene Generation for Gazebo Simulator

Testing robotic and cyberphysical systems in simulation require specific...
01/24/2019

F1/10: An Open-Source Autonomous Cyber-Physical Platform

In 2005 DARPA labeled the realization of viable autonomous vehicles (AVs...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.