Overview of the Ninth Dialog System Technology Challenge: DSTC9

11/12/2020
by   Chulaka Gunasekara, et al.
4

This paper introduces the Ninth Dialog System Technology Challenge (DSTC-9). This edition of the DSTC focuses on applying end-to-end dialog technologies for four distinct tasks in dialog systems, namely, 1. Task-oriented dialog Modeling with unstructured knowledge access, 2. Multi-domain task-oriented dialog, 3. Interactive evaluation of dialog, and 4. Situated interactive multi-modal dialog. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.

READ FULL TEXT
11/14/2019

The Eighth Dialog System Technology Challenge

This paper introduces the Eighth Dialog System Technology Challenge. In ...
07/28/2022

Interactive Evaluation of Dialog Track at DSTC9

The ultimate goal of dialog research is to develop systems that can be e...
04/23/2018

Knowledge-based end-to-end memory networks

End-to-end dialog systems have become very popular because they hold the...
06/22/2017

End-to-end Conversation Modeling Track in DSTC6

End-to-end training of neural networks is a promising approach to automa...
04/23/2018

Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems

End-to-end task-oriented dialog systems usually suffer from the challeng...
06/08/2016

DialPort: Connecting the Spoken Dialog Research Community to Real User Data

This paper describes a new spoken dialog portal that connects systems pr...
03/31/2016

Data Collection for Interactive Learning through the Dialog

This paper presents a dataset collected from natural dialogs which enabl...