Provenance and Pseudo-Provenance for Seeded Learning-Based Automated Test Generation

11/05/2017
by   Alex Groce, et al.
0

Many methods for automated software test generation, including some that explicitly use machine learning (and some that use ML more broadly conceived) derive new tests from existing tests (often referred to as seeds). Often, the seed tests from which new tests are derived are manually constructed, or at least simpler than the tests that are produced as the final outputs of such test generators. We propose annotation of generated tests with a provenance (trail) showing how individual generated tests of interest (especially failing tests) derive from seed tests, and how the population of generated tests relates to the original seed tests. In some cases, post-processing of generated tests can invalidate provenance information, in which case we also propose a method for attempting to construct "pseudo-provenance" describing how the tests could have been (partly) generated from seeds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2023

NLPLego: Assembling Test Generation for Natural Language Processing Applications

The development of modern NLP applications often relies on various bench...
research
10/05/2018

Automated Fix Detection Given Flaky Tests

Research Proposal in Automated Fix Detection...
research
05/30/2023

Majority Voting Approach to Ransomware Detection

Crypto-ransomware remains a significant threat to governments and compan...
research
04/14/2022

Constructing Open Cloze Tests Using Generation and Discrimination Capabilities of Transformers

This paper presents the first multi-objective transformer model for cons...
research
02/13/2023

Adaptive Test Generation Using a Large Language Model

Unit tests play a key role in ensuring the correctness of software. Howe...
research
06/02/2023

Automating Pipelines of A/B Tests with Population Split Using Self-Adaptation and Machine Learning

A/B testing is a common approach used in industry to facilitate innovati...
research
02/01/2018

Macros to Conduct Tests of Multimodality in SAS

The Dip Test of Unimodality and Silverman's Critical Bandwidth Test are ...

Please sign up or login with your details

Forgot password? Click here to reset