Falsification of Cyber-Physical Systems with Robustness-Guided Black-Box Checking

04/24/2020
by   Masaki Waga, et al.
0

For exhaustive formal verification, industrial-scale cyber-physical systems (CPSs) are often too large and complex, and lightweight alternatives (e.g., monitoring and testing) have attracted the attention of both industrial practitioners and academic researchers. Falsification is one popular testing method of CPSs utilizing stochastic optimization. In state-of-the-art falsification methods, the result of the previous falsification trials is discarded, and we always try to falsify without any prior knowledge. To concisely memorize such prior information on the CPS model and exploit it, we employ Black-box checking (BBC), which is a combination of automata learning and model checking. Moreover, we enhance BBC using the robust semantics of STL formulas, which is the essential gadget in falsification. Our experiment results suggest that our robustness-guided BBC outperforms a state-of-the-art falsification tool.

READ FULL TEXT
research
09/10/2021

Efficient Black-Box Checking via Model Checking with Strengthened Specifications

Black-box checking (BBC) is a testing method for cyber-physical systems ...
research
10/07/2019

Approximation-Refinement Testing of Compute-Intensive Cyber-Physical Models: An Approach Based on System Identification

Black-box testing has been extensively applied to test models of Cyber-P...
research
06/20/2018

Self-Driving Vehicle Verification Towards a Benchmark

Industrial cyber-physical systems are hybrid systems with strict safety ...
research
07/15/2023

Probabilistic Black-Box Checking via Active MDP Learning

We introduce a novel methodology for testing stochastic black-box system...
research
01/09/2022

A systematic literature review on counterexample explanation

Context: Safety is of paramount importance for cyber-physical systems in...
research
05/05/2023

On the Benefits of Semi-Supervised Test Case Generation for Cyber-Physical Systems

Testing complex Cyber Physical Systems (CPSs) can be expensive and time ...
research
09/06/2021

Any-horizon uniform random sampling and enumeration of constrained scenarios for simulation-based formal verification

Model-based approaches to the verification of non-terminating Cyber-Phys...

Please sign up or login with your details

Forgot password? Click here to reset