Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems

10/11/2021
by   Po-Nien Kung, et al.
0

Task-oriented dialogue systems have been a promising area in the NLP field. Previous work showed the effectiveness of using a single GPT-2 based model to predict belief states and responses via causal language modeling. In this paper, we leverage multi-task learning techniques to train a GPT-2 based model on a more challenging dataset with multiple domains, multiple modalities, and more diversity in output formats. Using only a single model, our method achieves better performance on all sub-tasks, across domains, compared to task and domain-specific models. Furthermore, we evaluated several proposed strategies for GPT-2 based dialogue systems with comprehensive ablation studies, showing that all techniques can further improve the performance.

READ FULL TEXT
research
09/26/2019

GECOR: An End-to-End Generative Ellipsis and Co-reference Resolution Model for Task-Oriented Dialogue

Ellipsis and co-reference are common and ubiquitous especially in multi-...
research
09/05/2019

Towards Task-Oriented Dialogue in Mixed Domains

This work investigates the task-oriented dialogue problem in mixed-domai...
research
09/29/2021

Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System

Pre-trained language models have been recently shown to benefit task-ori...
research
07/02/2022

A Multi-Task BERT Model for Schema-Guided Dialogue State Tracking

Task-oriented dialogue systems often employ a Dialogue State Tracker (DS...
research
07/10/2019

A Modular Task-oriented Dialogue System Using a Neural Mixture-of-Experts

End-to-end Task-oriented Dialogue Systems (TDSs) have attracted a lot of...
research
05/08/2018

One "Ruler" for All Languages: Multi-Lingual Dialogue Evaluation with Adversarial Multi-Task Learning

Automatic evaluating the performance of Open-domain dialogue system is a...
research
08/01/2022

On the Limitations of Sociodemographic Adaptation with Transformers

Sociodemographic factors (e.g., gender or age) shape our language. Previ...

Please sign up or login with your details

Forgot password? Click here to reset