Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation

09/14/2021
by   Chujie Zheng, et al.
0

Dialog grounding enables conversational models to make full use of external information to establish multiple desired qualities, such as knowledgeable, engaging and empathetic. However, naturally grounded dialog corpora are usually not directly available, which puts forward requirements for the few-shot learning ability of conversational models. Motivated by recent advances in pre-trained language models and prompt-based learning, in this paper we explore prompt-based few-shot learning for grounded dialog generation (GDG). We first formulate the prompt construction for GDG tasks, based on which we then conduct comprehensive empirical analysis on two common types of prompting methods: template-based prompting and soft-prompting. We demonstrate the potential of prompt-based methods in few-shot learning for GDG and provide directions of improvement for future work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/18/2022

A Study on Prompt-based Few-Shot Learning Methods for Belief State Tracking in Task-oriented Dialog Systems

We tackle the Dialogue Belief State Tracking(DST) problem of task-orient...
research
05/19/2020

Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption

Spoken dialog systems have seen applications in many domains, including ...
research
10/15/2021

Few-Shot Bot: Prompt-Based Learning for Dialogue Systems

Learning to converse using only a few examples is a great challenge in c...
research
01/24/2023

Opportunities and Challenges in Neural Dialog Tutoring

Designing dialog tutors has been challenging as it involves modeling the...
research
10/13/2022

Knowledge-grounded Dialog State Tracking

Knowledge (including structured knowledge such as schema and ontology, a...
research
03/31/2022

Leveraging pre-trained language models for conversational information seeking from text

Recent advances in Natural Language Processing, and in particular on the...
research
11/10/2020

Resource Constrained Dialog Policy Learning via Differentiable Inductive Logic Programming

Motivated by the needs of resource constrained dialog policy learning, w...

Please sign up or login with your details

Forgot password? Click here to reset