DeepAI AI Chat
Log In Sign Up

Multi-level Memory for Task Oriented Dialogs

by   Revanth Reddy, et al.

Recent end-to-end task oriented dialog systems use memory architectures to incorporate external knowledge in their dialogs. Current work makes simplifying assumptions about the structure of the knowledge base, such as the use of triples to represent knowledge, and combines dialog utterances (context) as well as knowledge base (KB) results as part of the same memory. This causes an explosion in the memory size, and makes the reasoning over memory harder. In addition, such a memory design forces hierarchical properties of the data to be fit into a triple structure of memory. This requires the memory reader to infer relationships across otherwise connected attributes. In this paper we relax the strong assumptions made by existing architectures and separate memories used for modeling dialog context and KB results. Instead of using triples to store KB results, we introduce a novel multi-level memory architecture consisting of cells for each query and their corresponding results. The multi-level memory first addresses queries, followed by results and finally each key-value pair within a result. We conduct detailed experiments on three publicly available task oriented dialog data sets and we find that our method conclusively outperforms current state-of-the-art models. We report a 15-25 both entity F1 and BLEU scores.


page 1

page 2

page 3

page 4


Constraint based Knowledge Base Distillation in End-to-End Task Oriented Dialogs

End-to-End task-oriented dialogue systems generate responses based on di...

Hierarchical Pointer Memory Network for Task Oriented Dialogue

We observe that end-to-end memory networks (MN) trained for task-oriente...

Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems

End-to-end task-oriented dialog systems usually suffer from the challeng...

Dual Semantic Knowledge Composed Multimodal Dialog Systems

Textual response generation is an essential task for multimodal task-ori...

Unsupervised Learning of KB Queries in Task Oriented Dialogs

Task-oriented dialog (TOD) systems converse with users to accomplish a s...

Spatial Language Representation with Multi-Level Geocoding

We present a multi-level geocoding model (MLG) that learns to associate ...

Gated End-to-End Memory Networks

Machine reading using differentiable reasoning models has recently shown...