Using causal inference and Bayesian statistics to explain the capability of a test suite in exposing software faults

03/17/2023
by   Alireza Aghamohammadi, et al.
0

Test effectiveness refers to the capability of a test suite in exposing faults in software. It is crucial to be aware of factors that influence this capability. We aim at inferring the causal relationship between the two factors (i.e., Cover/Exec) and the capability of a test suite to expose and discover faults in software. Cover refers to the number of distinct test cases covering the statement and Exec equals the number of times a test suite executes a statement. We analyzed 459166 software faults from 12 Java programs. Bayesian statistics along with the back-door criterion was exploited for the purpose of causal inference. Furthermore, we examined the common pitfall measuring association, the mixture of causal and noncausal relationships, instead of causal association. The results show that Cover is of more causal association as against Exec, and the causal association and noncausal one for those variables are statistically different. Software developers could exploit the results to design and write more effective test cases, which lead to discovering more bugs hidden in software.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2019

Comprehending Test Code: An Empirical Study

Developers spend a large portion of their time and effort on comprehendi...
research
08/27/2021

Developer-Centric Test Amplification The Interplay Between Automatic Generation and Human Exploration

Automatically generating test cases for software has been an active rese...
research
04/09/2020

A category theoretical argument for causal inference

The goal of this paper is to design a causal inference method accounting...
research
07/12/2019

iFixR: Bug Report driven Program Repair

Issue tracking systems are commonly used in modern software development ...
research
04/19/2022

Test suite effectiveness metric evaluation: what do we know and what should we do?

Comparing test suite effectiveness metrics has always been a research ho...
research
04/19/2021

Causal Program Dependence Analysis

We introduce Causal Program Dependence Analysis (CPDA), a dynamic depend...
research
06/07/2022

Confounder Analysis in Measuring Representation in Product Funnels

This paper discusses an application of Shapley values in the causal infe...

Please sign up or login with your details

Forgot password? Click here to reset