A Survey of Knowledge-Enhanced Text Generation

10/09/2020
by   Wenhao Yu, et al.
13

The goal of text generation is to make machines express in human language. It is one of the most important yet challenging tasks in natural language processing (NLP). Since 2014, various neural encoder-decoder models pioneered by Seq2Seq have been proposed to achieve the goal by learning to map input text to output text. However, the input text alone often provides limited knowledge to generate the desired output, so the performance of text generation is still far from satisfaction in many real-world scenarios. To address this issue, researchers have considered incorporating various forms of knowledge beyond the input text into the generation models. This research direction is known as knowledge-enhanced text generation. In this survey, we present a comprehensive review of the research on knowledge enhanced text generation over the past five years. The main content includes two parts: (i) general methods and architectures for integrating knowledge into text generation; (ii) specific techniques and applications according to different forms of knowledge data. This survey can have broad audiences, researchers and practitioners, in academia and industry.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/21/2021

Pretrained Language Models for Text Generation: A Survey

Text generation has become one of the most important yet challenging tas...
research
03/02/2020

Towards information-rich, logical text generation with knowledge-enhanced neural models

Text generation system has made massive promising progress contributed b...
research
03/16/2022

TegTok: Augmenting Text Generation via Task-specific and Open-world Knowledge

Generating natural and informative texts has been a long-standing proble...
research
07/25/2022

Innovations in Neural Data-to-text Generation

The neural boom that has sparked natural language processing (NLP) resea...
research
10/14/2020

Dissecting the components and factors of Neural Text Generation

Neural text generation metamorphosed into several critical natural langu...
research
09/26/2022

Informative Text Generation from Knowledge Triples

As the development of the encoder-decoder architecture, researchers are ...
research
12/21/2022

A Mutation-based Text Generation for Adversarial Machine Learning Applications

Many natural language related applications involve text generation, crea...

Please sign up or login with your details

Forgot password? Click here to reset