Production Monitoring to Improve Test Suites

12/02/2020
by   Deepika Tiwari, et al.
0

Software testing ensures that a software system behaves as intended. In this paper, we identify the methods in a software system that need better testing, and propose to use production executions to improve test suites. We devise an approach called PANKTI which monitors applications as they execute in production, and then automatically generates unit tests from the collected production data. We implement our tool for Java and evaluate it on three real-world, open-source projects: a videoconferencing system, a PDF manipulation library, and an e-commerce application. We show that PANKTI is able to generate unit tests for weakly-tested methods by monitoring them in production, and that the generated tests indeed improve the quality of the test suite of the application under consideration.

READ FULL TEXT

page 7

page 8

research
08/02/2022

Mimicking Production Behavior with Generated Mocks

Mocking in the context of automated software tests allows testing progra...
research
12/15/2021

Harvesting Production GraphQL Queries to Detect Schema Faults

GraphQL is a new paradigm to design web APIs. Despite its growing popula...
research
05/18/2020

Generating Unit Tests for Documentation

Software projects capture information in various kinds of artifacts, inc...
research
02/09/2023

RICK: Generating Mocks from Production Data

Test doubles, such as mocks and stubs, are nifty fixtures in unit tests....
research
02/05/2023

Simulation-Driven Automated End-to-End Test and Oracle Inference

This is the first work to report on inferential testing at scale in indu...
research
01/13/2020

Testing with Jupyter notebooks: NoteBook VALidation (nbval) plug-in for pytest

The Notebook validation tool nbval allows to load and execute Python cod...
research
02/27/2023

Soft-Search: Two Datasets to Study the Identification and Production of Research Software

Software is an important tool for scholarly work, but software produced ...

Please sign up or login with your details

Forgot password? Click here to reset