DeepAI
Log In Sign Up

Grounding Dialogue Systems via Knowledge Graph Aware Decoding with Pre-trained Transformers

03/30/2021
by   Debanjan Chaudhuri, et al.
15

Generating knowledge grounded responses in both goal and non-goal oriented dialogue systems is an important research challenge. Knowledge Graphs (KG) can be viewed as an abstraction of the real world, which can potentially facilitate a dialogue system to produce knowledge grounded responses. However, integrating KGs into the dialogue generation process in an end-to-end manner is a non-trivial task. This paper proposes a novel architecture for integrating KGs into the response generation process by training a BERT model that learns to answer using the elements of the KG (entities and relations) in a multi-task, end-to-end setting. The k-hop subgraph of the KG is incorporated into the model during training and inference using Graph Laplacian. Empirical evaluation suggests that the model achieves better knowledge groundedness (measured via Entity F1 score) compared to other state-of-the-art models for both goal and non-goal oriented dialogues.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/17/2019

Using a KG-Copy Network for Non-Goal Oriented Dialogues

Non-goal oriented, generative dialogue systems lack the ability to gener...
01/28/2020

Incorporating Joint Embeddings into Goal-Oriented Dialogues with Multi-Task Learning

Attention-based encoder-decoder neural network models have recently show...
04/17/2021

Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding

Dialogue systems powered by large pre-trained language models (LM) exhib...
04/19/2022

DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation

Task-oriented dialogue generation is challenging since the underlying kn...
12/03/2022

RHO (ρ): Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding

Dialogue systems can leverage large pre-trained language models and know...
03/20/2022

Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems

Users interacting with voice assistants today need to phrase their reque...
04/16/2022

UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue

The goal-oriented document-grounded dialogue aims at responding to the u...