A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues

05/19/2016
by   Iulian Vlad Serban, et al.
0

Sequential data often possesses a hierarchical structure with complex dependencies between subsequences, such as found between the utterances in a dialogue. In an effort to model this kind of generative process, we propose a neural network-based generative architecture, with latent stochastic variables that span a variable number of time steps. We apply the proposed model to the task of dialogue response generation and compare it with recent neural network architectures. We evaluate the model performance through automatic evaluation metrics and by carrying out a human evaluation. The experiments demonstrate that our model improves upon recently proposed models and that the latent variables facilitate the generation of long outputs and maintain the context.

READ FULL TEXT
research
02/20/2017

Latent Variable Dialogue Models and their Diversity

We present a dialogue generation model that directly captures the variab...
research
11/18/2016

Generative Deep Neural Networks for Dialogue: A Short Review

Researchers have recently started investigating deep neural networks for...
research
06/15/2018

Stochastic WaveNet: A Generative Latent Variable Model for Sequential Data

How to model distribution of sequential data, including but not limited ...
research
05/18/2023

Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generation

Goal-oriented Script Generation is a new task of generating a list of st...
research
04/10/2022

DISK: Domain-constrained Instance Sketch for Math Word Problem Generation

A math word problem (MWP) is a coherent narrative which reflects the und...
research
02/06/2018

Improving Variational Encoder-Decoders in Dialogue Generation

Variational encoder-decoders (VEDs) have shown promising results in dial...
research
10/07/2022

GOLLIC: Learning Global Context beyond Patches for Lossless High-Resolution Image Compression

Neural-network-based approaches recently emerged in the field of data co...

Please sign up or login with your details

Forgot password? Click here to reset