Improving Test Automation Maturity: a Multivocal Literature Review

02/18/2022
by   Yuqing Wang, et al.
0

Mature test automation is key for achieving software quality at speed. In this paper, we present a multivocal literature review with the objective to survey and synthesize the guidelines given in the literature for improving test automation maturity. We selected and reviewed 81 primary studies, consisting of 26 academic literature and 55 grey literature sources. From primary studies, we extracted 26 test automation best practices (e.g., Define an effective test automation strategy, Set up good test environments, Develop high-quality test scripts) and collected many pieces of advice (e.g., in forms of implementation/improvement approaches, technical techniques, concepts, experience-based heuristics) on how to conduct these best practices. We made main observations: (1) There are only 6 best practices whose positive effect on maturity improvement have been evaluated by academic studies using formal empirical methods; (2) Several technical related best practices in this MLR were not presented in test maturity models; (3) Some best practices can be linked to success factors and maturity impediments proposed by other scholars; (4) Most pieces of advice on how to conduct proposed best practices were identified from experience studies and their effectiveness need to be further evaluated with cross-site empirical evidence using formal empirical methods; (5) In the literature, some advice on how to conduct certain best practices are conflicting, and some advice on how to conduct certain best practices still need further qualitative analysis.

READ FULL TEXT

page 2

page 11

page 13

research
04/14/2020

Test Automation Process Improvement in a DevOpsTeam: Experience Report

How to successfully conduct test automation process improvement (TAPI) f...
research
09/15/2022

Two case studies on implementing best practices for Software Process Improvement

Software Process Improvement requires significant effort related not onl...
research
06/15/2021

Best Practices for Notification Studies for Security and Privacy Issues on the Internet

Researchers help operators of vulnerable and non-compliant internet serv...
research
07/28/2022

Logic and Accuracy Testing: A Fifty-State Review

Pre-election logic and accuracy (L A) testing is a process in which el...
research
04/20/2020

Software Test Automation Maturity – A Survey of the State of the Practice

The software industry has seen an increasing interest in test automation...
research
05/19/2021

Statistical Learning for Best Practices in Tattoo Removal

The causes behind complications in laser-assisted tattoo removal are cur...
research
02/07/2022

Test Automation Maturity Improves Product Quality – Quantitative Study of Open Source Projects Using Continuous Integration

The popularity of continuous integration (CI) is increasing as a result ...

Please sign up or login with your details

Forgot password? Click here to reset