Characterizing High-Quality Test Methods: A First Empirical Study

03/22/2022
by   Victor Veloso, et al.
0

To assess the quality of a test suite, one can rely on mutation testing, which computes whether the overall test cases are adequately exercising the covered lines. However, this high level of granularity may overshadow the quality of individual test methods. In this paper, we propose an empirical study to assess the quality of test methods by relying on mutation testing at the method level. We find no major differences between high-quality and low-quality test methods in terms of size, number of asserts, and modifications. In contrast, high-quality test methods are less affected by critical test smells. Finally, we discuss practical implications for researchers and practitioners.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/28/2018

Goal-oriented Mutation Testing with Focal Methods

Mutation testing is the state-of-the-art technique for assessing the fau...
research
03/13/2019

Is the Stack Distance Between Test Case and Method Correlated With Test Effectiveness?

Mutation testing is a means to assess the effectiveness of a test suite ...
research
07/10/2020

Not Your Grandfathers Test Set: Reducing Labeling Effort for Testing

Building and maintaining high-quality test sets remains a laborious and ...
research
08/16/2021

Statistical Learning to Operationalize a Domain Agnostic Data Quality Scoring

Data is expanding at an unimaginable rate, and with this development com...
research
07/17/2019

Mutation Testing with Hyperproperties

We present a new method for model-based mutation-driven test case genera...
research
01/25/2022

Data-driven Mutation Analysis for Cyber-Physical Systems

Cyber-physical systems (CPSs) typically consist of a wide set of integra...
research
05/27/2023

Synthesizing Speech Test Cases with Text-to-Speech? An Empirical Study on the False Alarms in Automated Speech Recognition Testing

Recent studies have proposed the use of Text-To-Speech (TTS) systems to ...

Please sign up or login with your details

Forgot password? Click here to reset