Test Model Coverage Analysis under Uncertainty

09/11/2019
by   I. S. W. B. Prasetya, et al.
0

In model-based testing (MBT) we may have to deal with a non-deterministic model, e.g. because abstraction was applied, or because the software under test itself is non-deterministic. The same test case may then trigger multiple possible execution paths, depending on some internal decisions made by the software. Consequently, performing precise test analyses, e.g. to calculate the test coverage, are not possible. This can be mitigated if developers can annotate the model with estimated probabilities for taking each transition. A probabilistic model checking algorithm can subsequently be used to do simple probabilistic coverage analysis. However, in practice developers often want to know what the achieved aggregate coverage, which unfortunately cannot be re-expressed as a standard model checking problem. This paper presents an extension to allow efficient calculation of probabilistic aggregate coverage, and moreover also in combination with k-wise coverage.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2018

From Model Checking to Runtime Verification and Back

We describe a novel approach for adapting an existing software model che...
research
07/27/2019

Combining closed-loop test generation and execution by means of model checking

Model checking is an established technique to formally verify automation...
research
03/02/2021

The High-Assurance ROS Framework

This tool paper presents the High-Assurance ROS (HAROS) framework. HAROS...
research
09/16/2016

Model-based Test Generation for Robotic Software: Automata versus Belief-Desire-Intention Agents

Robotic code needs to be verified to ensure its safety and functional co...
research
07/17/2019

Mutation Testing with Hyperproperties

We present a new method for model-based mutation-driven test case genera...
research
03/28/2018

Towards Efficient Data-flow Test Data Generation

Data-flow testing (DFT) checks the correctness of variable definitions b...
research
07/11/2023

Introducing Asynchronicity to Probabilistic Hyperproperties

Probabilistic hyperproperties express probabilistic relations between di...

Please sign up or login with your details

Forgot password? Click here to reset