Visual Analysis of Hyperproperties for Understanding Model Checking Results

08/08/2021
by   Tom Horak, et al.
0

Model checkers provide algorithms for proving that a mathematical model of a system satisfies a given specification. In case of a violation, a counterexample that shows the erroneous behavior is returned. Understanding these counterexamples is challenging, especially for hyperproperty specifications, i.e., specifications that relate multiple executions of a system to each other. We aim to facilitate the visual analysis of such counterexamples through our HyperVis tool, which provides interactive visualizations of the given model, specification, and counterexample. Within an iterative and interdisciplinary design process, we developed visualization solutions that can effectively communicate the core aspects of the model checking result. Specifically, we introduce graphical representations of binary values for improving pattern recognition, color encoding for better indicating related aspects, visually enhanced textual descriptions, as well as extensive cross-view highlighting mechanisms. Further, through an underlying causal analysis of the counterexample, we are also able to identify values that contributed to the violation and use this knowledge for both improved encoding and highlighting. Finally, the analyst can modify both the specification of the hyperproperty and the system directly within HyperVis and initiate the model checking of the new version. In combination, these features notably support the analyst in understanding the error leading to the counterexample as well as iterating the provided system and specification. We ran multiple case studies with HyperVis and tested it with domain experts in qualitative feedback sessions. The participants' positive feedback confirms the considerable improvement over the manual, text-based status quo and the value of the tool for explaining hyperproperties.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 7

page 9

page 10

page 11

research
08/18/2021

Timed Automata Robustness Analysis via Model Checking

Timed automata (TA) have been widely adopted as a suitable formalism to ...
research
07/24/2022

OCTAL: Graph Representation Learning for LTL Model Checking

Model Checking is widely applied in verifying the correctness of complex...
research
10/14/2020

A spatial model checker in GPU (extended version)

The tool voxlogica merges the state-of-the-art library of computational ...
research
12/30/2020

Visual counterexample explanation for model checking with Oeritte

Despite being one of the most reliable approaches for ensuring system co...
research
07/05/2023

Towards a Formal Verification of the Lightning Network with TLA+

Payment channel networks are an approach to improve the scalability of b...
research
05/24/2018

DesignBIP: A Design Studio for Modeling and Generating Systems with BIP

The Behavior-Interaction-Priority (BIP) framework, rooted in rigorous se...
research
07/29/2021

Counterexample Classification

In model checking, when a given model fails to satisfy the desired speci...

Please sign up or login with your details

Forgot password? Click here to reset