DeepAI AI Chat
Log In Sign Up

Falsification of Cyber-Physical Systems using Bayesian Optimization

09/14/2022
by   Zahra Ramezani, et al.
Chalmers University of Technology
LUNDS TEKNISKA HÖGSKOLA
Stanford University
0

Cyber-physical systems (CPSs) are usually complex and safety-critical; hence, it is difficult and important to guarantee that the system's requirements, i.e., specifications, are fulfilled. Simulation-based falsification of CPSs is a practical testing method that can be used to raise confidence in the correctness of the system by only requiring that the system under test can be simulated. As each simulation is typically computationally intensive, an important step is to reduce the number of simulations needed to falsify a specification. We study Bayesian optimization (BO), a sample-efficient method that learns a surrogate model that describes the relationship between the parametrization of possible input signals and the evaluation of the specification. In this paper, we improve the falsification using BO by; first adopting two prominent BO methods, one fits local surrogate models, and the other exploits the user's prior knowledge. Secondly, the formulation of acquisition functions for falsification is addressed in this paper. Benchmark evaluation shows significant improvements in using local surrogate models of BO for falsifying benchmark examples that were previously hard to falsify. Using prior knowledge in the falsification process is shown to be particularly important when the simulation budget is limited. For some of the benchmark problems, the choice of acquisition function clearly affects the number of simulations needed for successful falsification.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/01/2018

Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning

With the rapid development of software and distributed computing, Cyber-...
09/01/2020

Quantifying the Latency and Possible Throughput of External Interrupts on Cyber-Physical Systems

An important characteristic of cyber-physical systems is their capabilit...
06/24/2018

Cyber-Physical Specification Mismatches

Embedded systems use increasingly complex software and are evolving into...
03/11/2020

Trusted Confidence Bounds for Learning Enabled Cyber-Physical Systems

Cyber-physical systems (CPS) can benefit by the use of learning enabled ...
10/13/2020

Adaptive Testing for Specification Coverage

Ensuring correctness of cyber-physical systems (CPS) is an extremely cha...
09/21/2020

DISPATCH: Design Space Exploration of Cyber-Physical Systems

Design of cyber-physical systems (CPSs) is a challenging task that invol...
10/20/2021

Part-X: A Family of Stochastic Algorithms for Search-Based Test Generation with Probabilistic Guarantees

Requirements driven search-based testing (also known as falsification) h...