Leveraging Models to Reduce Test Cases in Software Repositories

03/22/2021
by   Golnaz Gharachorlu, et al.
0

Given a failing test case, test case reduction yields a smaller test case that reproduces the failure. This process can be time consuming due to repeated trial and error with smaller test cases. Current techniques speed up reduction by only exploring syntactically valid candidates, but they still spend significant effort on semantically invalid candidates. In this paper, we propose a model-guided approach to speed up test case reduction. The approach trains a model of semantic properties driven by syntactic test case properties. By using this model, we can skip testing even syntactically valid test case candidates that are unlikely to succeed. We evaluate this model-guided reduction on a suite of 14 large fuzzer-generated C test cases from the bug repositories of two well-known C compilers, GCC and Clang. Our results show that with an average precision of 77 trials by 14 over the state of the art technique while preserving similar reduction power.

READ FULL TEXT
research
04/08/2021

Extending Hierarchical Delta Debugging with Hoisting

Minimizing failing test cases is an important pre-processing step on the...
research
02/28/2022

Automatic Test-Case Reduction in Proof Assistants: A Case Study in Coq

As the adoption of proof assistants increases, there is a need for effic...
research
05/14/2019

Faster Creation of Smaller Test Suites (with SNAP)

State-of-the-art theorem provers, combined with smart sampling heuristic...
research
07/08/2021

Duplicate-sensitivity Guided Transformation Synthesis for DBMS Correctness Bug Detection

Database Management System (DBMS) plays a core role in modern software f...
research
01/08/2021

Faster SAT Solving for Software with Repeated Structures (with Case Studies on Software Test Suite Minimization)

Theorem provers has been used extensively in software engineering for so...
research
06/11/2018

Greybox fuzzing as a contextual bandits problem

Greybox fuzzing is one of the most useful and effective techniques for t...
research
03/07/2021

Growing a Test Corpus with Bonsai Fuzzing

This paper presents a coverage-guided grammar-based fuzzing technique fo...

Please sign up or login with your details

Forgot password? Click here to reset