Graph-based Multi-hop Reasoning for Long Text Generation

09/28/2020
by   Liang Zhao, et al.
0

Long text generation is an important but challenging task.The main problem lies in learning sentence-level semantic dependencies which traditional generative models often suffer from. To address this problem, we propose a Multi-hop Reasoning Generation (MRG) approach that incorporates multi-hop reasoning over a knowledge graph to learn semantic dependencies among sentences. MRG consists of twoparts, a graph-based multi-hop reasoning module and a path-aware sentence realization module. The reasoning module is responsible for searching skeleton paths from a knowledge graph to imitate the imagination process in the human writing for semantic transfer. Based on the inferred paths, the sentence realization module then generates a complete sentence. Unlike previous black-box models, MRG explicitly infers the skeleton path, which provides explanatory views tounderstand how the proposed model works. We conduct experiments on three representative tasks, including story generation, review generation, and product description generation. Automatic and manual evaluation show that our proposed method can generate more informative and coherentlong text than strong baselines, such as pre-trained models(e.g. GPT-2) and knowledge-enhanced models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/24/2020

Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph

Despite the success of generative pre-trained language models on a serie...
research
08/06/2021

Sentence Semantic Regression for Text Generation

Recall the classical text generation works, the generation framework can...
research
08/21/2018

A Skeleton-Based Model for Promoting Coherence Among Sentences in Narrative Story Generation

Narrative story generation is a challenging problem because it demands t...
research
03/25/2019

Knowledge Aware Conversation Generation with Reasoning on Augmented Graph

Two types of knowledge, factoid knowledge from graphs and non-factoid kn...
research
10/19/2020

Multi-hop Question Generation with Graph Convolutional Network

Multi-hop Question Generation (QG) aims to generate answer-related quest...
research
01/17/2022

SQUIRE: A Sequence-to-sequence Framework for Multi-hop Knowledge Graph Reasoning

Multi-hop knowledge graph (KG) reasoning has been widely studied in rece...
research
10/15/2020

GMH: A General Multi-hop Reasoning Model for KG Completion

Knowledge graphs are essential for numerous downstream natural language ...

Please sign up or login with your details

Forgot password? Click here to reset