Differential coverage: automating coverage analysis

08/18/2020
by   Henry Cox, et al.
0

While it is easy to automate coverage data collection, it is a time consuming/difficult/expensive manual process to analyze the data so that it can be acted upon. Complexity arises from numerous sources, of which untested or poorly tested legacy code and third-party libraries are two of the most common. Differential coverage and date binning are methods of combining coverage data and project/file history to determine if goals have been met and to identify areas of code which should be prioritized. These methods can be applied to any coverage metric which can be associated with a location – statement, function, expression, toggle, etc. – and to any language, including both software (C++, Python, etc.) and hardware description languages (SystemVerilog, VHDL). The goal of these approaches is to reduce the cost and the barrier to entry of using coverage data analysis in large-scale projects. The approach is realized in gendiffcov, a recently released open-source tool.

READ FULL TEXT
research
06/19/2021

Test case prioritization using test case diversification and fault-proneness estimations

Context: Regression testing activities greatly reduce the risk of faulty...
research
07/25/2023

Predicting Code Coverage without Execution

Code coverage is a widely used metric for quantifying the extent to whic...
research
02/23/2018

SmartUnit: Empirical Evaluations for Automated Unit Testing of Embedded Software in Industry

In this paper, we aim at the automated unit coverage-based testing for e...
research
08/07/2019

Meander Based River Coverage by an Autonomous Surface Vehicle

Autonomous coverage has tremendous importance for environmental surveyin...
research
03/11/2021

Using Relative Lines of Code to Guide Automated Test Generation for Python

Raw lines of code (LOC) is a metric that does not, at first glance, seem...
research
04/20/2018

Ticket Coverage: Putting Test Coverage into Context

There is no metric that determines how well the implementation of a tick...
research
09/02/2023

Pressmatch: Automated journalist recommendation for media coverage with Nearest Neighbor search

Slating a product for release often involves pitching journalists to run...

Please sign up or login with your details

Forgot password? Click here to reset