Parsel: A Unified Natural Language Framework for Algorithmic Reasoning

12/20/2022
by   Eric Zelikman, et al.
0

Despite recent success in large language model (LLM) reasoning, LLMs still struggle with hierarchical multi-step reasoning like generating complex programs. In these cases, humans often start with a high-level algorithmic design and implement each part gradually. We introduce Parsel, a framework enabling automatic implementation and validation of complex algorithms with code LLMs, based on hierarchical function descriptions in natural language. Parsel can be used across domains requiring hierarchical reasoning, e.g. code synthesis, theorem proving, and robotic planning. We demonstrate Parsel's capabilities by using it to generate complex programs that cannot currently be automatically implemented from one description and backtranslating Python programs in the APPS dataset. Beyond modeling capabilities, Parsel allows problem-solving with high-level algorithmic designs, benefiting both students and professional programmers.

READ FULL TEXT

page 19

page 20

page 23

page 25

page 28

page 29

page 32

page 33

research
07/15/2023

Leveraging Large Language Models to Generate Answer Set Programs

Large language models (LLMs), such as GPT-3 and GPT-4, have demonstrated...
research
04/07/2023

Towards Generating Functionally Correct Code Edits from Natural Language Issue Descriptions

Large language models (LLMs), such as OpenAI's Codex, have demonstrated ...
research
08/17/2015

Reasoning in complex environments with the SelectScript declarative language

SelectScript is an extendable, adaptable, and declarative domain-specifi...
research
08/25/2021

Subgoal Search For Complex Reasoning Tasks

Humans excel in solving complex reasoning tasks through a mental process...
research
06/19/2018

VirtualHome: Simulating Household Activities via Programs

In this paper, we are interested in modeling complex activities that occ...
research
09/17/2023

Optimal Scene Graph Planning with Large Language Model Guidance

Recent advances in metric, semantic, and topological mapping have equipp...
research
12/06/2022

Codex Hacks HackerRank: Memorization Issues and a Framework for Code Synthesis Evaluation

The Codex model has demonstrated extraordinary competence in synthesizin...

Please sign up or login with your details

Forgot password? Click here to reset