UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2

12/07/2020
by   Yunyi Yang, et al.
0

This paper presents our task-oriented dialog system UBAR which models task-oriented dialogs on a dialog session level. Specifically, UBAR is acquired by fine-tuning the large pre-trained unidirectional language model GPT-2 on the sequence of the entire dialog session which is composed of user utterance, belief state, database result, system act, and system response of every dialog turn. Additionally, UBAR is evaluated in a more realistic setting, where its dialog context has access to user utterances and all content it generated such as belief states, system acts, and system responses. Experimental results on the MultiWOZ datasets show that UBAR achieves state-of-the-art performances in multiple settings, improving the combined score of response generation, policy optimization, and end-to-end modeling by 4.7, 3.5, and 9.4 points respectively. points. Thorough analyses demonstrate that the session-level training sequence formulation and the generated dialog context are essential for UBAR to operate as a fully end-to-end task-oriented dialog system in real life. We also examine the transfer ability of UBAR to new domains with limited data and provide visualization and a case study to illustrate the advantages of UBAR in modeling on a dialog session level.

READ FULL TEXT
research
10/17/2022

Mars: Semantic-aware Contrastive Learning for End-to-End Task-Oriented Dialog

Traditional end-to-end task-oriented dialog systems first convert dialog...
research
01/30/2023

Contextual Dynamic Prompting for Response Generation in Task-oriented Dialog Systems

Response generation is one of the critical components in task-oriented d...
research
09/15/2022

UBARv2: Towards Mitigating Exposure Bias in Task-Oriented Dialogs

This paper studies the exposure bias problem in task-oriented dialog sys...
research
05/15/2020

Feature Fusion Strategies for End-to-End Evaluation of Cognitive Behavior Therapy Sessions

Cognitive Behavioral Therapy (CBT) is a goal-oriented psychotherapy for ...
research
05/05/2022

BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog

A typical end-to-end task-oriented dialog system transfers context into ...
research
06/22/2021

End-to-End Task-Oriented Dialog Modeling with Semi-Structured Knowledge Management

Current task-oriented dialog (TOD) systems mostly manage structured know...
research
12/15/2021

Database Search Results Disambiguation for Task-Oriented Dialog Systems

As task-oriented dialog systems are becoming increasingly popular in our...

Please sign up or login with your details

Forgot password? Click here to reset