Growing a Test Corpus with Bonsai Fuzzing

by   Vasudev Vikram, et al.

This paper presents a coverage-guided grammar-based fuzzing technique for automatically generating a corpus of concise test inputs for programs such as compilers. We walk-through a case study of a compiler designed for education and the corresponding problem of generating meaningful test cases to provide to students. The prior state-of-the-art solution is a combination of fuzzing and test-case reduction techniques such as variants of delta-debugging. Our key insight is that instead of attempting to minimize convoluted fuzzer-generated test inputs, we can instead grow concise test inputs by construction using a form of iterative deepening. We call this approach Bonsai Fuzzing. Experimental results show that Bonsai Fuzzing can generate test corpora having inputs that are 16–45 approach, while achieving approximately the same code coverage and fault-detection capability.



page 7

page 10


Regression Test Case Prioritization by Code Combinations Coverage

Regression test case prioritization (RTCP) aims to improve the rate of f...

Improving The Effectiveness of Automatically Generated Test Suites Using Metamorphic Testing

Automated test generation has helped to reduce the cost of software test...

How do students test software units?

We gained insight into ideas and beliefs on testing of students who fini...

Inputs from Hell Generating Uncommon Inputs from Common Samples

Generating structured input files to test programs can be performed by t...

Superion: Grammar-Aware Greybox Fuzzing

In recent years, coverage-based greybox fuzzing has proven itself to be ...

Test Case Prioritization Using Partial Attention

Test case prioritization (TCP) aims to reorder the regression test suite...

DCO Analyzer: Local Controllability and Observability Analysis and Enforcement of Distributed Test Scenarios

To ensure interoperability and the correct behavior of heterogeneous dis...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.