How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Models

09/03/2022
by   Hai Dang, et al.
7

Deep generative models have the potential to fundamentally change the way we create high-fidelity digital content but are often hard to control. Prompting a generative model is a promising recent development that in principle enables end-users to creatively leverage zero-shot and few-shot learning to assign new tasks to an AI ad-hoc, simply by writing them down. However, for the majority of end-users writing effective prompts is currently largely a trial and error process. To address this, we discuss the key opportunities and challenges for interactive creative applications that use prompting as a new paradigm for Human-AI interaction. Based on our analysis, we propose four design goals for user interfaces that support prompting. We illustrate these with concrete UI design sketches, focusing on the use case of creative writing. The research community in HCI and AI can take these as starting points to develop adequate user interfaces for models capable of zero- and few-shot learning.

READ FULL TEXT
research
05/03/2021

One Model to Rule them All: Towards Zero-Shot Learning for Databases

In this paper, we present our vision of so called zero-shot learning for...
research
09/11/2020

Visually Analyzing and Steering Zero Shot Learning

We propose a visual analytics system to help a user analyze and steer ze...
research
07/10/2018

Geometric Generalization Based Zero-Shot Learning Dataset Infinite World: Simple Yet Powerful

Raven's Progressive Matrices are one of the widely used tests in evaluat...
research
02/08/2023

From Zero-Shot to Few-Shot Learning: A Step of Embedding-Aware Generative Models

Embedding-aware generative model (EAGM) addresses the data insufficiency...
research
06/05/2023

Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction

Coaching, which involves classroom observation and expert feedback, is a...
research
06/08/2023

Can AI Moderate Online Communities?

The task of cultivating healthy communication in online communities beco...
research
06/02/2023

Sampling and Ranking for Digital Ink Generation on a tight computational budget

Digital ink (online handwriting) generation has a number of potential ap...

Please sign up or login with your details

Forgot password? Click here to reset