Learning Multi-Level Information for Dialogue Response Selection by Highway Recurrent Transformer

03/21/2019
by   Ting-Rui Chiang, et al.
0

With the increasing research interest in dialogue response generation, there is an emerging branch formulating this task as selecting next sentences, where given the partial dialogue contexts, the goal is to determine the most probable next sentence. Following the recent success of the Transformer model, this paper proposes (1) a new variant of attention mechanism based on multi-head attention, called highway attention, and (2) a recurrent model based on transformer and the proposed highway attention, so-called Highway Recurrent Transformer. Experiments on the response selection task in the seventh Dialog System Technology Challenge (DSTC7) show the capability of the proposed model of modeling both utterance-level and dialogue-level information; the effectiveness of each module is further analyzed as well.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/21/2019

RAP-Net: Recurrent Attention Pooling Networks for Dialogue Response Selection

The response selection has been an emerging research topic due to the gr...
research
01/17/2020

Multi-step Joint-Modality Attention Network for Scene-Aware Dialogue System

Understanding dynamic scenes and dialogue contexts in order to converse ...
research
07/09/2019

ReCoSa: Detecting the Relevant Contexts with Self-Attention for Multi-turn Dialogue Generation

In multi-turn dialogue generation, response is usually related with only...
research
03/02/2020

Toward Interpretability of Dual-Encoder Models for Dialogue Response Suggestions

This work shows how to improve and interpret the commonly used dual enco...
research
03/02/2023

CTRLStruct: Dialogue Structure Learning for Open-Domain Response Generation

Dialogue structure discovery is essential in dialogue generation. Well-s...
research
10/01/2019

Dialogue Transformers

We introduce a dialogue policy based on a transformer architecture, wher...
research
06/16/2019

SEntNet: Source-aware Recurrent Entity Network for Dialogue Response Selection

Dialogue response selection is an important part of Task-oriented Dialog...

Please sign up or login with your details

Forgot password? Click here to reset