Qualities of Quality: A Tertiary Review of Software Quality Measurement Research

by   Kaylea Champion, et al.
University of Washington

This paper presents a tertiary review of software quality measurement research. To conduct this review, we examined an initial dataset of 7,811 articles and found 75 relevant and high-quality secondary analyses of software quality research. Synthesizing this body of work, we offer an overview of perspectives, measurement approaches, and trends. We identify five distinct perspectives that conceptualize quality as heuristic, as maintainability, as a holistic concept, as structural features of software, and as dependability. We also identify three key challenges. First, we find widespread evidence of validity questions with common measures. Second, we observe the application of machine learning methods without adequate evaluation. Third, we observe the use of aging datasets. Finally, from these observations, we sketch a path toward a theoretical framework that will allow software engineering researchers to systematically confront these weaknesses while remaining grounded in the experiences of developers and the real world in which code is ultimately deployed.


page 1

page 2

page 3

page 4


Code Smells and Refactoring: A Tertiary Systematic Review of Challenges and Observations

In this paper, we present a tertiary systematic literature review of pre...

Grey Literature in Software Engineering: A Critical Review

Context: Grey Literature (GL) recently has grown in Software Engineering...

Psychometrics in Behavioral Software Engineering: A Methodological Introduction with Guidelines

Humans are what constitutes the most complex and complicated, yet fascin...

Towards Resolving Software Quality-in-Use Measurement Challenges

Software quality-in-use comprehends the quality from user's perspectives...

Behavioral Software Engineering: Methodological Introduction to Psychometrics

Humans are what constitutes the most complex and complicated, yet fascin...

A Review On Software Defects Prediction Methods

Software quality is one of the essential aspects of a software. With inc...

Success and Failure in Software Engineering: a Followup Systematic Literature Review

Success and failure in software engineering are still among the least un...

Please sign up or login with your details

Forgot password? Click here to reset