Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology

05/09/2019
by   Shuo Feng, et al.
0

Testing and evaluation is a critical step in the development and deployment of connected and automated vehicles (CAVs), and yet there is no systematic framework to generate testing scenario library. This paper aims to provide a general framework to solve the testing scenario library generation (TSLG) problem for different scenario types, CAV models, and performance metrics. In part I of the paper, four research questions are identified: (1) scenario description, (2) metric design, (3) library generation, and (4) CAV evaluation. To answer these questions, a unified framework is proposed. First, the operational design domain of CAVs is considered for scenario description and decision variable formulation. Second, a set of incremental performance metrics are designed including safety, functionality, mobility, and rider's comfort. Third, a new definition of criticality is proposed as a combination of maneuver challenge and exposure frequency, and a critical scenario searching method is designed based on multi-start optimization and seed-fill method. Finally, with the generated library, CAVs can be evaluated through three steps: scenario sampling, field testing, and index value estimation. The proposed framework is theoretically proved to obtain accurate evaluation results with much fewer number of tests, compared with public road test method. In part II of the paper, three case studies are investigated to demonstrate the proposed methodologies. Reinforcement learning based technique is applied to enhance the method under high-dimensional scenarios.

READ FULL TEXT

page 1

page 9

page 12

research
05/09/2019

Testing Scenario Library Generation for Connected and Automated Vehicles, Part II: Case Studies

Testing and evaluation is a critical step in the development and deploym...
research
11/03/2020

A Scenario-Based Development Framework for Autonomous Driving

This article summarizes the research progress of scenario-based testing ...
research
06/12/2023

Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles

Interaction between the background vehicles (BVs) and automated vehicles...
research
06/02/2022

A Real-time Critical-scenario-generation Framework for Testing Autonomous Driving System

In order to find the most likely failure scenarios which may occur under...
research
06/15/2021

Plane and Sample: Maximizing Information about Autonomous Vehicle Performance using Submodular Optimization

As autonomous vehicles (AVs) take on growing Operational Design Domains ...
research
02/02/2023

Vectorized Scenario Description and Motion Prediction for Scenario-Based Testing

Automated vehicles (AVs) are tested in diverse scenarios, typically spec...
research
05/19/2020

Pass-Fail Criteria for Scenario-Based Testing of Automated Driving Systems

The MUSICC project has created a proof-of-concept scenario database to b...

Please sign up or login with your details

Forgot password? Click here to reset