AI Chat

The Adaptive Stress Testing Formulation

04/08/2020

∙

by Mark Koren, et al.

∙

∙

Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find failures without unsafe simplifications. This paper presents the theory behind one such black-box approach: adaptive stress testing (AST). We also provide three examples of validation problems formulated to work with AST.

Mark Koren
7 publications
Anthony Corso
13 publications
Mykel J. Kochenderfer
144 publications

∙ 11/04/2020

Adaptive Stress Testing of Trajectory Predictions in Flight Management Systems

To find failure events and their likelihoods in flight-critical systems,...

0 Robert J. Moss, et al. ∙

∙ 08/02/2019

Adaptive Stress Testing with Reward Augmentation for Autonomous Vehicle Validation

Determining possible failure scenarios is a critical step in the evaluat...

0 Anthony Corso, et al. ∙

∙ 03/05/2020

Validation of Image-Based Neural Network Controllers through Adaptive Stress Testing

Neural networks have become state-of-the-art for computer vision problem...

0 Kyle D. Julian, et al. ∙

∙ 11/06/2018

Adaptive Stress Testing: Finding Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to ...

0 Ritchie Lee, et al. ∙

∙ 07/16/2019

Efficient Autonomy Validation in Simulation with Adaptive Stress Testing

During the development of autonomous systems such as driverless cars, it...

2 Mark Koren, et al. ∙

∙ 03/27/2020

Adversarial Stress Testing of Lifetime Distributions

In this paper we put forward the viewpoint that the notion of stress tes...

0 Nozer Singpurwalla, et al. ∙

∙ 08/14/2023

Robustness Stress Testing in Medical Image Classification

Deep neural networks have shown impressive performance for image-based d...

0 Mobarakol Islam, et al. ∙