NAPS: Natural Program Synthesis Dataset

07/06/2018
by   Maksym Zavershynskyi, et al.
0

We present a program synthesis-oriented dataset consisting of human written problem statements and solutions for these problems. The problem statements were collected via crowdsourcing and the program solutions were extracted from human-written solutions in programming competitions, accompanied by input/output examples. We propose using this dataset for the program synthesis tasks aimed for working with real user-generated data. As a baseline we present few models, with the best model achieving 8.8 complexity of the dataset and large room for future research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/29/2021

Latent Execution for Neural Program Synthesis Beyond Domain-Specific Languages

Program synthesis from input-output examples has been a long-standing ch...
research
09/17/2013

A fully automatic problem solver with human-style output

This paper describes a program that solves elementary mathematical probl...
research
07/15/2021

A Reinforcement Learning Environment for Mathematical Reasoning via Program Synthesis

We convert the DeepMind Mathematics Dataset into a reinforcement learnin...
research
03/16/2022

Less is More: Summary of Long Instructions is Better for Program Synthesis

Despite the success of large pre-trained language models (LMs) such as C...
research
12/06/2022

Codex Hacks HackerRank: Memorization Issues and a Framework for Code Synthesis Evaluation

The Codex model has demonstrated extraordinary competence in synthesizin...
research
09/08/2022

Knowledge-Driven Program Synthesis via Adaptive Replacement Mutation and Auto-constructed Subprogram Archives

We introduce Knowledge-Driven Program Synthesis (KDPS) as a variant of t...
research
06/10/2021

PSB2: The Second Program Synthesis Benchmark Suite

For the past six years, researchers in genetic programming and other pro...

Please sign up or login with your details

Forgot password? Click here to reset