Building a Personalized Dialogue System with Prompt-Tuning

06/11/2022
by   Tomohito Kasahara, et al.
0

Dialogue systems without consistent responses are not fascinating. In this study, we build a dialogue system that can respond based on a given character setting (persona) to bring consistency. Considering the trend of the rapidly increasing scale of language models, we propose an approach that uses prompt-tuning, which has low learning costs, on pre-trained large-scale language models. The results of automatic and manual evaluations in English and Japanese show that it is possible to build a dialogue system with more natural and personalized responses using less computational resources than fine-tuning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2022

A Comparative Study on Language Models for Task-Oriented Dialogue Systems

The recent development of language models has shown promising results by...
research
05/18/2023

SimOAP: Improve Coherence and Consistency in Persona-based Dialogue Generation via Over-sampling and Post-evaluation

Language models trained on large-scale corpora can generate remarkably f...
research
05/06/2023

Controllable Mixed-Initiative Dialogue Generation through Prompting

Mixed-initiative dialogue tasks involve repeated exchanges of informatio...
research
06/13/2023

PersonaPKT: Building Personalized Dialogue Agents via Parameter-efficient Knowledge Transfer

Personalized dialogue agents (DAs) powered by large pre-trained language...
research
09/11/2021

Empirical Analysis of Training Strategies of Transformer-based Japanese Chit-chat Systems

In recent years, several high-performance conversational systems have be...
research
04/24/2023

ChatLLM Network: More brains, More intelligence

Dialogue-based language models mark a huge milestone in the field of art...
research
08/16/2023

MDDial: A Multi-turn Differential Diagnosis Dialogue Dataset with Reliability Evaluation

Dialogue systems for Automatic Differential Diagnosis (ADD) have a wide ...

Please sign up or login with your details

Forgot password? Click here to reset