Low-code LLM: Visual Programming over LLMs

04/17/2023
by   Yuzhe Cai, et al.
0

Effectively utilizing LLMs for complex tasks is challenging, often involving a time-consuming and uncontrollable prompt engineering process. This paper introduces a novel human-LLM interaction framework, Low-code LLM. It incorporates six types of simple low-code visual programming interactions, all supported by clicking, dragging, or text editing, to achieve more controllable and stable responses. Through visual interaction with a graphical user interface, users can incorporate their ideas into the workflow without writing trivial prompts. The proposed Low-code LLM framework consists of a Planning LLM that designs a structured planning workflow for complex tasks, which can be correspondingly edited and confirmed by users through low-code visual programming operations, and an Executing LLM that generates responses following the user-confirmed workflow. We highlight three advantages of the low-code LLM: controllable generation results, user-friendly human-LLM interaction, and broadly applicable scenarios. We demonstrate its benefits using four typical applications. By introducing this approach, we aim to bridge the gap between humans and LLMs, enabling more effective and efficient utilization of LLMs for complex tasks. Our system will be soon publicly available at LowCodeLLM.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/27/2023

SeeHow: Workflow Extraction from Programming Screencasts through Action-Aware Video Analytics

Programming screencasts (e.g., video tutorials on Youtube or live coding...
research
07/31/2023

A Composable Just-In-Time Programming Framework with LLMs and FBP

This paper introduces a computing framework that combines Flow-Based Pro...
research
04/16/2023

VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping

In argumentative writing, writers must brainstorm hierarchical writing g...
research
12/07/2010

Process Makna - A Semantic Wiki for Scientific Workflows

Virtual e-Science infrastructures supporting Web-based scientific workfl...
research
06/08/2023

When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programming

AI powered code-recommendation systems, such as Copilot and CodeWhispere...
research
06/20/2023

Lingua Manga: A Generic Large Language Model Centric System for Data Curation

Data curation is a wide-ranging area which contains many critical but ti...
research
06/19/2019

Controllable Planning, Responsibility, and Information in automatic Driving Technology

People hope automated driving technology should be always in a stable an...

Please sign up or login with your details

Forgot password? Click here to reset