What Makes Agile Test Artifacts Useful? An Activity-Based Quality Model from a Practitioners' Perspective

by   Jannik Fischbach, et al.

Background: The artifacts used in Agile software testing and the reasons why these artifacts are used are fairly well-understood. However, empirical research on how Agile test artifacts are eventually designed in practice and which quality factors make them useful for software testing remains sparse. Aims: Our objective is two-fold. First, we identify current challenges in using test artifacts to understand why certain quality factors are considered good or bad. Second, we build an Activity-Based Artifact Quality Model that describes what Agile test artifacts should look like. Method: We conduct an industrial survey with 18 practitioners from 12 companies operating in seven different domains. Results: Our analysis reveals nine challenges and 16 factors describing the quality of six test artifacts from the perspective of Agile testers. Interestingly, we observed mostly challenges regarding language and traceability, which are well-known to occur in non-Agile projects. Conclusions: Although Agile software testing is becoming the norm, we still have little confidence about general do's and don'ts going beyond conventional wisdom. This study is the first to distill a list of quality factors deemed important to what can be considered as useful test artifacts.



page 1

page 2

page 3

page 4


Agile Methods: Testing Challenges, Solutions Tool Support

Agile development is conventional these days and with the passage of tim...

Boundary Objects and their Use in Agile Systems Engineering

Agile methods are increasingly introduced in automotive companies in the...

Beneficial and Harmful Agile Practices for Product Quality

There is the widespread belief that Agile neglects the product quality. ...

"Doing" Agile versus "Being" Agile. Empirical Results from 250+ Projects

In numerous occasions Agile practitioners have warned about the negative...

The Integrated List of Agile Practices – A Tertiary Study

Context: Companies adapt agile methods, practices or artifacts for their...

Agile-CMMI Alignment: CMMI V2.0 Contributions and To-dos for Organizations

CMMI and Agile can work together. Over 80 conducted at agile organizatio...

Choosing agile or plan-driven enterprise resource planning (ERP) implementations -- A study on 21 implementations from 20 companies

Agile methods have gotten a good reputation for managing projects in man...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.