Towards Property-Based Tests in Natural Language

02/08/2022
by   Colin S. Gordon, et al.
0

We consider a new approach to generate tests from natural language. Rather than relying on machine learning or templated extraction from structured comments, we propose to apply classic ideas from linguistics to translate natural-language sentences into executable tests. This paper explores the application of combinatory categorial grammars (CCGs) to generating property-based tests. Our prototype is able to generate tests from English descriptions for each example in a textbook chapter on property-based testing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2023

Can Large Language Models Write Good Property-Based Tests?

Property-based testing (PBT), while an established technique in the soft...
research
10/15/2018

Generating Comments From Source Code with CCGs

Good comments help developers understand software faster and provide bet...
research
04/27/2021

Shellcode_IA32: A Dataset for Automatic Shellcode Generation

We take the first step to address the task of automatically generating s...
research
05/06/2020

Probing the Natural Language Inference Task with Automated Reasoning Tools

The Natural Language Inference (NLI) task is an important task in modern...
research
06/17/2019

Manipulating the Difficulty of C-Tests

We propose two novel manipulation strategies for increasing and decreasi...
research
08/27/2020

DAVE: Deriving Automatically Verilog from English

While specifications for digital systems are provided in natural languag...
research
03/27/2020

Detection and Description of Change in Visual Streams

This paper presents a framework for the analysis of changes in visual st...

Please sign up or login with your details

Forgot password? Click here to reset