Growing a Test Corpus with Bonsai Fuzzing

03/07/2021
by   Vasudev Vikram, et al.
0

This paper presents a coverage-guided grammar-based fuzzing technique for automatically generating a corpus of concise test inputs for programs such as compilers. We walk-through a case study of a compiler designed for education and the corresponding problem of generating meaningful test cases to provide to students. The prior state-of-the-art solution is a combination of fuzzing and test-case reduction techniques such as variants of delta-debugging. Our key insight is that instead of attempting to minimize convoluted fuzzer-generated test inputs, we can instead grow concise test inputs by construction using a form of iterative deepening. We call this approach Bonsai Fuzzing. Experimental results show that Bonsai Fuzzing can generate test corpora having inputs that are 16–45 approach, while achieving approximately the same code coverage and fault-detection capability.

READ FULL TEXT

Authors

page 7

page 10

07/01/2020

Regression Test Case Prioritization by Code Combinations Coverage

Regression test case prioritization (RTCP) aims to improve the rate of f...
04/18/2020

Improving The Effectiveness of Automatically Generated Test Suites Using Metamorphic Testing

Automated test generation has helped to reduce the cost of software test...
02/16/2021

How do students test software units?

We gained insight into ideas and beliefs on testing of students who fini...
12/18/2018

Inputs from Hell Generating Uncommon Inputs from Common Samples

Generating structured input files to test programs can be performed by t...
12/04/2018

Superion: Grammar-Aware Greybox Fuzzing

In recent years, coverage-based greybox fuzzing has proven itself to be ...
06/22/2022

Test Case Prioritization Using Partial Attention

Test case prioritization (TCP) aims to reorder the regression test suite...
04/09/2020

DCO Analyzer: Local Controllability and Observability Analysis and Enforcement of Distributed Test Scenarios

To ensure interoperability and the correct behavior of heterogeneous dis...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.