DeepAI AI Chat
Log In Sign Up

DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generation

by   Xinyu Hua, et al.

We study the task of long-form opinion text generation, which faces at least two distinct challenges. First, existing neural generation models fall short of coherence, thus requiring efficient content planning. Second, diverse types of information are needed to guide the generator to cover both subjective and objective content. To this end, we propose DYPLOC, a generation framework that conducts dynamic planning of content while generating the output based on a novel design of mixed language models. To enrich the generation with diverse content, we further propose to use large pre-trained models to predict relevant concepts and to generate claims. We experiment with two challenging tasks on newly collected datasets: (1) argument generation with Reddit ChangeMyView, and (2) writing articles using New York Times' Opinion section. Automatic evaluation shows that our model significantly outperforms competitive comparisons. Human judges further confirm that our generations are more coherent with richer content.


page 1

page 8

page 15

page 16


PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation

Despite recent progress of pre-trained language models on generating flu...

Sentence-Level Content Planning and Style Specification for Neural Text Generation

Building effective text generation systems requires three critical compo...

PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation

Pre-trained Transformers have enabled impressive breakthroughs in genera...

Expository Text Generation: Imitate, Retrieve, Paraphrase

Expository documents are vital resources for conveying complex informati...

Argument Generation with Retrieval, Planning, and Realization

Automatic argument generation is an appealing but challenging task. In t...

Unsupervised Melody-Guided Lyrics Generation

Automatic song writing is a topic of significant practical interest. How...

Elaborative Simplification: Content Addition and Explanation Generation in Text Simplification

Much of modern day text simplification research focuses on sentence-leve...