The Adaptive Stress Testing Formulation

by   Mark Koren, et al.

Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find failures without unsafe simplifications. This paper presents the theory behind one such black-box approach: adaptive stress testing (AST). We also provide three examples of validation problems formulated to work with AST.


Adaptive Stress Testing of Trajectory Predictions in Flight Management Systems

To find failure events and their likelihoods in flight-critical systems,...

Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validation

Determining possible failure scenarios is a critical step in the evaluat...

Validation of Image-Based Neural Network Controllers through Adaptive Stress Testing

Neural networks have become state-of-the-art for computer vision problem...

Adaptive Stress Testing: Finding Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to ...

Efficient Autonomy Validation in Simulation with Adaptive Stress Testing

During the development of autonomous systems such as driverless cars, it...

Adversarial Stress Testing of Lifetime Distributions

In this paper we put forward the viewpoint that the notion of stress tes...

Robustness Stress Testing in Medical Image Classification

Deep neural networks have shown impressive performance for image-based d...

Please sign up or login with your details

Forgot password? Click here to reset