The Adaptive Stress Testing Formulation

04/08/2020
by   Mark Koren, et al.
0

Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find failures without unsafe simplifications. This paper presents the theory behind one such black-box approach: adaptive stress testing (AST). We also provide three examples of validation problems formulated to work with AST.

READ FULL TEXT
11/04/2020

Adaptive Stress Testing of Trajectory Predictions in Flight Management Systems

To find failure events and their likelihoods in flight-critical systems,...
08/02/2019

Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validation

Determining possible failure scenarios is a critical step in the evaluat...
03/05/2020

Validation of Image-Based Neural Network Controllers through Adaptive Stress Testing

Neural networks have become state-of-the-art for computer vision problem...
11/06/2018

Adaptive Stress Testing: Finding Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to ...
07/16/2019

Efficient Autonomy Validation in Simulation with Adaptive Stress Testing

During the development of autonomous systems such as driverless cars, it...
03/27/2020

Adversarial Stress Testing of Lifetime Distributions

In this paper we put forward the viewpoint that the notion of stress tes...
08/14/2023

Robustness Stress Testing in Medical Image Classification

Deep neural networks have shown impressive performance for image-based d...

Please sign up or login with your details

Forgot password? Click here to reset