Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models

by   Iulian V. Serban, et al.
Université de Montréal

We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up the possibility for realistic, flexible interactions. In support of this goal, we extend the recently proposed hierarchical recurrent encoder-decoder neural network to the dialogue domain, and demonstrate that this model is competitive with state-of-the-art neural language models and back-off n-gram models. We investigate the limitations of this and similar approaches, and show how its performance can be improved by bootstrapping the learning from a larger question-answer pair corpus and from pretrained word embeddings.


page 1

page 2

page 3

page 4


Simplified Hierarchical Recurrent Encoder-Decoder for Building End-To-End Dialogue Systems

As a generative model for building end-to-end dialogue systems, Hierarch...

PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model

In the research of end-to-end dialogue systems, using real-world knowled...

Hybrid Code Networks using a convolutional neural network as an input layer achieves higher turn accuracy

The dialogue management is a task of conversational artificial intellige...

Recipes for Safety in Open-domain Chatbots

Models trained on large unlabeled corpora of human interactions will lea...

Flowstorm: Open-Source Platform with Hybrid Dialogue Architecture

This paper presents a conversational AI platform called Flowstorm. Flows...

Retrieval-based Goal-Oriented Dialogue Generation

Most research on dialogue has focused either on dialogue generation for ...

PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanism

We investigate response generation for multi-turn dialogue in generative...

Code Repositories


Hierarchical Encoder Decoder RNN (HRED) with Truncated Backpropagation Through Time (Truncated BPTT)

view repo


A neural conversation model

view repo


default code to run in lab

view repo

Please sign up or login with your details

Forgot password? Click here to reset