On Incorporating Structural Information to improve Dialogue Response Generation

05/28/2020
by   Nikita Moghe, et al.
0

We consider the task of generating dialogue responses from background knowledge comprising of domain specific resources. Specifically, given a conversation around a movie, the task is to generate the next response based on background knowledge about the movie such as the plot, review, Reddit comments etc. This requires capturing structural, sequential and semantic information from the conversation context and the background resources. This is a new task and has not received much attention from the community. We propose a new architecture that uses the ability of BERT to capture deep contextualized representations in conjunction with explicit structure and sequence information. More specifically, we use (i) Graph Convolutional Networks (GCNs) to capture structural information, (ii) LSTMs to capture sequential information and (iii) BERT for the deep contextualized representations that capture semantic information. We analyze the proposed architecture extensively. To this end, we propose a plug-and-play Semantics-Sequences-Structures (SSS) framework which allows us to effectively combine such linguistic information. Through a series of experiments we make some interesting observations. First, we observe that the popular adaptation of the GCN model for NLP tasks where structural information (GCNs) was added on top of sequential information (LSTMs) performs poorly on our task. This leads us to explore interesting ways of combining semantic and structural information to improve the performance. Second, we observe that while BERT already outperforms other deep contextualized representations such as ELMo, it still benefits from the additional structural information explicitly added using GCNs. This is a bit surprising given the recent claims that BERT already captures structural information. Lastly, the proposed SSS framework gives an improvement of 7.95

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2018

Towards Exploiting Background Knowledge for Building Conversation Systems

Existing dialog datasets contain a sequence of utterances and responses ...
research
02/04/2023

Knowledge Graph Completion Method Combined With Adaptive Enhanced Semantic Information

Translation models tend to ignore the rich semantic information in triad...
research
12/07/2020

Dialogue Discourse-Aware Graph Convolutional Networks for Abstractive Meeting Summarization

Sequence-to-sequence methods have achieved promising results for textual...
research
04/25/2023

What does BERT learn about prosody?

Language models have become nearly ubiquitous in natural language proces...
research
11/09/2018

Incorporating Relevant Knowledge in Context Modeling and Response Generation

To sustain engaging conversation, it is critical for chatbots to make go...
research
10/31/2021

An Approach to Inference-Driven Dialogue Management within a Social Chatbot

We present a chatbot implementing a novel dialogue management approach b...

Please sign up or login with your details

Forgot password? Click here to reset