A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering

09/21/2021
by   Muhammad Usman, et al.
0

Context: Systematic literature reviews (SLRs) have become standard practise as part of software engineering research, although their quality varies. To build on the reviews, both for future research and industry practice, they need to be of high quality. Objective: To assess the quality of SLRs in software engineering, we put forward an appraisal instrument for SLRs. The instrument is intended for use by appraisers of reviews, but authors may also use it as a checklist when designing and documenting their reviews. Method: A well-established appraisal instrument from research in healthcare was used as a starting point to develop a quality assessment instrument. It is adapted to software engineering using guidelines, checklists, and experiences from software engineering. As a validation step, the first version was reviewed by four external experts on SLRs in software engineering and updated based on their feedback. Results: The outcome of the research is an appraisal instrument for the quality assessment of SLRs in software engineering. The instrument intends to support the appraiser in assessing the quality of an SLR. The instrument includes 16 items with different options to capture the quality. The item is assessed on a two or three-grade scale, depending on the item. The instrument also supports consolidating the items into groups, which are then used to assess the overall quality of a systematic literature review. Conclusion: It is concluded that the presented instrument may be helpful support for an appraiser in assessing the quality of SLRs in software engineering.

READ FULL TEXT

page 5

page 6

research
10/07/2021

How Tertiary Studies perform Quality Assessment of Secondary Studies in Software Engineering

Context: Tertiary studies are becoming increasingly popular in software ...
research
01/28/2019

An Empirically Evaluated Checklist for Surveys in Software Engineering

Context: Over the past decade Software Engineering research has seen a s...
research
08/15/2023

Research Software Engineering in 2030

This position paper for an invited talk on the "Future of eScience" disc...
research
09/02/2020

Understanding Peer Review of Software Engineering Papers

Peer review is a key activity intended to preserve the quality and integ...
research
03/11/2021

Exploring the Mysteries of System-Level Test

System-level test, or SLT, is an increasingly important process step in ...
research
06/09/2022

Analysis of Learner Independent Variables for Estimating Assessment Items Difficulty Level

The quality of assessment determines the quality of learning, and is cha...
research
09/16/2022

A Decade of Code Comment Quality Assessment: A Systematic Literature Review

Code comments are important artifacts in software systems and play a par...

Please sign up or login with your details

Forgot password? Click here to reset