The Adaptive Stress Testing Formulation

04/08/2020
by   Mark Koren, et al.
0

Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find failures without unsafe simplifications. This paper presents the theory behind one such black-box approach: adaptive stress testing (AST). We also provide three examples of validation problems formulated to work with AST.

READ FULL TEXT
research
11/04/2020

Adaptive Stress Testing of Trajectory Predictions in Flight Management Systems

To find failure events and their likelihoods in flight-critical systems,...
research
08/02/2019

Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validation

Determining possible failure scenarios is a critical step in the evaluat...
research
03/05/2020

Validation of Image-Based Neural Network Controllers through Adaptive Stress Testing

Neural networks have become state-of-the-art for computer vision problem...
research
11/06/2018

Adaptive Stress Testing: Finding Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to ...
research
07/16/2019

Efficient Autonomy Validation in Simulation with Adaptive Stress Testing

During the development of autonomous systems such as driverless cars, it...
research
03/27/2020

Adversarial Stress Testing of Lifetime Distributions

In this paper we put forward the viewpoint that the notion of stress tes...
research
08/14/2023

Robustness Stress Testing in Medical Image Classification

Deep neural networks have shown impressive performance for image-based d...

Please sign up or login with your details

Forgot password? Click here to reset