Overview of the Ninth Dialog System Technology Challenge: DSTC9

by   Chulaka Gunasekara, et al.

This paper introduces the Ninth Dialog System Technology Challenge (DSTC-9). This edition of the DSTC focuses on applying end-to-end dialog technologies for four distinct tasks in dialog systems, namely, 1. Task-oriented dialog Modeling with unstructured knowledge access, 2. Multi-domain task-oriented dialog, 3. Interactive evaluation of dialog, and 4. Situated interactive multi-modal dialog. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.


The Eighth Dialog System Technology Challenge

This paper introduces the Eighth Dialog System Technology Challenge. In ...

Interactive Evaluation of Dialog Track at DSTC9

The ultimate goal of dialog research is to develop systems that can be e...

Knowledge-based end-to-end memory networks

End-to-end dialog systems have become very popular because they hold the...

End-to-end Conversation Modeling Track in DSTC6

End-to-end training of neural networks is a promising approach to automa...

Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems

End-to-end task-oriented dialog systems usually suffer from the challeng...

DialPort: Connecting the Spoken Dialog Research Community to Real User Data

This paper describes a new spoken dialog portal that connects systems pr...

Data Collection for Interactive Learning through the Dialog

This paper presents a dataset collected from natural dialogs which enabl...