Toward Generating Sufficiently Valid Test Case Results: A Method for Systematically Assigning Test Cases to Test Bench Configurations in a Scenario-Based Test Approach for Auto

09/07/2021
by   Markus Steimle, et al.
0

For the market launch of automated vehicles, proof must be provided in advance that they operate safely. However, the problem of how to validate their safe operation remains unsolved. While scenario-based test approaches seem to be possible solutions, they require the execution of a large number of test cases. Several test benches are available to execute these test cases, from actual test vehicles to partly or fully simulated environments. Each test bench provides different elements, which, in turn, have different parameters and parameter ranges. The composition of elements with their specific parameter values on a specific test bench used to execute a test case is referred to as a test bench configuration. However, selecting the most suitable test bench configuration is challenging. The selected test bench configuration determines the actual performance of the test bench. Therefore, it determines whether the execution of a specific test case provides sufficiently valid test case results with respect to the intended purpose, for example, validating a vehicle's safe operation. The effective and efficient execution of a large number of test cases requires a method for systematically assigning test cases to the most suitable test bench configuration. Based on a proposed method for classifying test bench configurations, we propose and illustrate a method for systematically assigning test cases to test bench configurations in a scenario-based test approach for automated vehicles. This assignment method allows for the effective and efficient execution of a large number of test cases while generating sufficiently valid test case results.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 11

page 13

page 16

page 23

research
05/22/2019

A Method for Classifying Test Bench Configurations in a Scenario-Based Test Approach for Automated Vehicles

The introduction of automated vehicles demands a way to prove their safe...
research
09/06/2021

ViSTA: a Framework for Virtual Scenario-based Testing of Autonomous Vehicles

In this paper, we present ViSTA, a framework for Virtual Scenario-based ...
research
06/11/2018

Greybox fuzzing as a contextual bandits problem

Greybox fuzzing is one of the most useful and effective techniques for t...
research
08/26/2020

Identification of Challenging Highway-Scenarios for the Safety Validation of Automated Vehicles Based on Real Driving Data

For a successful market launch of automated vehicles (AVs), proof of the...
research
10/15/2018

Finding a boundary between valid and invalid regions of the input space

In the context of robustness testing, the boundary between the valid and...
research
05/28/2020

Unlucky Explorer: A Complete non-Overlapping Map Exploration

Nowadays, the field of Artificial Intelligence in Computer Games (AI in ...
research
10/05/2020

Automated Reasoning and Detection of Specious Configuration in Large Systems with Symbolic Execution

Misconfiguration is a major cause of system failures. Prior solutions fo...

Please sign up or login with your details

Forgot password? Click here to reset