DLGNet-Task: An End-to-end Neural Network Framework for Modeling Multi-turn Multi-domain Task-Oriented Dialogue

10/04/2020
by   Oluwatobi O. Olabiyi, et al.
4

Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain dialogue generation capabilities of streamlined end-to-end open-domain dialogue systems. In this paper, we present a new framework, DLGNet-Task, a unified task-oriented dialogue system which employs autoregressive transformer networks such as DLGNet and GPT-2/3 to complete user tasks in multi-turn multi-domain conversations. Our framework enjoys the controllable, verifiable, and explainable outputs of modular approaches, and the low development, deployment and maintenance cost of end-to-end systems. Treating open-domain system components as additional TOD system modules allows DLGNet-Task to learn the joint distribution of the inputs and outputs of all the functional blocks of existing modular approaches such as, natural language understanding (NLU), state tracking, action policy, as well as natural language generation (NLG). Rather than training the modules individually, as is common in real-world systems, we trained them jointly with appropriate module separations. When evaluated on the MultiWOZ2.1 dataset, DLGNet-Task shows comparable performance to the existing state-of-the-art approaches. Furthermore, using DLGNet-Task in conversational AI systems reduces the level of effort required for developing, deploying, and maintaining intelligent assistants at scale.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

08/24/2021

Taming the Beast: Learning to Control Neural Conversational Models

This thesis investigates the controllability of deep learning-based, end...
04/19/2021

Alexa Conversations: An Extensible Data-driven Approach for Building Task-oriented Dialogue Systems

Traditional goal-oriented dialogue systems rely on various components su...
12/03/2016

End-to-End Joint Learning of Natural Language Understanding and Dialogue Manager

Natural language understanding and dialogue policy learning are both ess...
03/03/2017

End-to-End Task-Completion Neural Dialogue Systems

One of the major drawbacks of modularized task-completion dialogue syste...
07/10/2019

A Modular Task-oriented Dialogue System Using a Neural Mixture-of-Experts

End-to-end Task-oriented Dialogue Systems (TDSs) have attracted a lot of...
08/30/2019

Modeling Multi-Action Policy for Task-Oriented Dialogues

Dialogue management (DM) plays a key role in the quality of the interact...
10/16/2019

Generating Challenge Datasets for Task-Oriented Conversational Agents through Self-Play

End-to-end neural approaches are becoming increasingly common in convers...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.