Knowledge-based Review Generation by Coherence Enhanced Text Planning

05/09/2021
by   Junyi Li, et al.
6

As a natural language generation task, it is challenging to generate informative and coherent review text. In order to enhance the informativeness of the generated text, existing solutions typically learn to copy entities or triples from knowledge graphs (KGs). However, they lack overall consideration to select and arrange the incorporated knowledge, which tends to cause text incoherence. To address the above issue, we focus on improving entity-centric coherence of the generated reviews by leveraging the semantic structure of KGs. In this paper, we propose a novel Coherence Enhanced Text Planning model (CETP) based on knowledge graphs (KGs) to improve both global and local coherence for review generation. The proposed model learns a two-level text plan for generating a document: (1) the document plan is modeled as a sequence of sentence plans in order, and (2) the sentence plan is modeled as an entity-based subgraph from KG. Local coherence can be naturally enforced by KG subgraphs through intra-sentence correlations between entities. For global coherence, we design a hierarchical self-attentive architecture with both subgraph- and node-level attention to enhance the correlations between subgraphs. To our knowledge, we are the first to utilize a KG-based text planning model to enhance text coherence for review generation. Extensive experiments on three datasets confirm the effectiveness of our model on improving the content coherence of generated texts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/09/2022

Plug-and-Play Recipe Generation with Content Planning

Recent pre-trained language models have shown promising capabilities in ...
research
09/15/2021

Towards Document-Level Paraphrase Generation with Sentence Rewriting and Reordering

Paraphrase generation is an important task in natural language processin...
research
04/28/2015

Leveraging Deep Neural Networks and Knowledge Graphs for Entity Disambiguation

Entity Disambiguation aims to link mentions of ambiguous entities to a k...
research
12/08/2021

Learning to Select the Next Reasonable Mention for Entity Linking

Entity linking aims to establish a link between entity mentions in a doc...
research
10/04/2020

Knowledge-Enhanced Personalized Review Generation with Capsule Graph Neural Network

Personalized review generation (PRG) aims to automatically produce revie...
research
06/11/2019

Generating Long and Informative Reviews with Aspect-Aware Coarse-to-Fine Decoding

Generating long and informative review text is a challenging natural lan...
research
09/30/2019

Towards Controllable and Personalized Review Generation

In this paper, we propose a novel model RevGAN that automatically genera...

Please sign up or login with your details

Forgot password? Click here to reset