T-Wise Presence Condition Coverage and Sampling for Configurable Systems

05/30/2022
by   Sebastian Krieter, et al.
0

Sampling techniques, such as t-wise interaction sampling are used to enable efficient testing for configurable systems. This is achieved by generating a small yet representative sample of configurations for a system, which circumvents testing the entire solution space. However, by design, most recent approaches for t-wise interaction sampling only consider combinations of configuration options from a configurable system's variability model and do not take into account their mapping onto the solution space, thus potentially leaving critical implementation artifacts untested. Tartler et al. address this problem by considering presence conditions of implementation artifacts rather than pure configuration options, but do not consider the possible interactions between these artifacts. In this paper, we introduce t-wise presence condition coverage, which extends the approach of Tartler et al. by using presence conditions extracted from the code as basis to cover t-wise interactions. This ensures that all t-wise interactions of implementation artifacts are included in the sample and that the chance of detecting combinations of faulty configuration options is increased. We evaluate our approach in terms of testing efficiency and testing effectiveness by comparing the approach to existing t-wise interaction sampling techniques. We show that t-wise presence condition sampling is able to produce mostly smaller samples compared to t-wise interaction sampling, while guaranteeing a t-wise presence condition coverage of 100

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/28/2019

iGen: Dynamic Interaction Inference for Configurable Software

To develop, analyze, and evolve today's highly configurable software sys...
research
02/13/2021

GenTree: Using Decision Trees to Learn Interactions for Configurable Software

Modern software systems are increasingly designed to be highly configura...
research
10/22/2017

Test them all, is it worth it? A ground truth comparison of configuration sampling strategies

Many approaches for testing configurable software systems start from the...
research
06/14/2020

Support Estimation with Sampling Artifacts and Errors

The problem of estimating the support of a distribution is of great impo...
research
07/27/2023

Can Quantum Computing Improve Uniform Random Sampling of Large Configuration Spaces? (Preprint)

A software product line models the variability of highly configurable sy...
research
05/31/2022

Synthesizing Configuration Tactics for Exercising Hidden Options in Serverless Systems

A proper configuration of an information system can ensure accuracy and ...
research
07/04/2014

Identifying Higher-order Combinations of Binary Features

Finding statistically significant interactions between binary variables ...

Please sign up or login with your details

Forgot password? Click here to reset