Learning End-to-End Goal-Oriented Dialog

05/24/2016
by   Antoine Bordes, et al.
0

Traditional dialog systems used in goal-oriented applications require a lot of domain-specific handcrafting, which hinders scaling up to new domains. End-to-end dialog systems, in which all components are trained from the dialogs themselves, escape this limitation. But the encouraging success recently obtained in chit-chat dialog may not carry over to goal-oriented settings. This paper proposes a testbed to break down the strengths and shortcomings of end-to-end dialog systems in goal-oriented applications. Set in the context of restaurant reservation, our tasks require manipulating sentences and symbols, so as to properly conduct conversations, issue API calls and use the outputs of such calls. We show that an end-to-end dialog system based on Memory Networks can reach promising, yet imperfect, performance and learn to perform non-trivial operations. We confirm those results by comparing our system to a hand-crafted slot-filling baseline on data from the second Dialog State Tracking Challenge (Henderson et al., 2014a). We show similar result patterns on data extracted from an online concierge service.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2018

Learning End-to-End Goal-Oriented Dialog with Multiple Answers

In a dialog, there can be multiple valid next utterances at any point. T...
research
06/22/2017

Personalization in Goal-Oriented Dialog

The main goal of modeling human conversation is to create agents which c...
research
04/23/2018

Knowledge-based end-to-end memory networks

End-to-end dialog systems have become very popular because they hold the...
research
11/21/2015

Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systems

A long-term goal of machine learning is to build intelligent conversatio...
research
06/09/2021

Joint System-Wise Optimization for Pipeline Goal-Oriented Dialog System

Recent work (Takanobu et al., 2020) proposed the system-wise evaluation ...
research
08/16/2022

TexPrax: A Messaging Application for Ethical, Real-time Data Collection and Annotation

Collecting and annotating task-oriented dialog data is difficult, especi...
research
05/15/2020

Is Your Goal-Oriented Dialog Model Performing Really Well? Empirical Analysis of System-wise Evaluation

There is a growing interest in developing goal-oriented dialog systems w...

Please sign up or login with your details

Forgot password? Click here to reset