Sentence-Permuted Paragraph Generation

04/15/2021
by   Wenhao Yu, et al.
0

Generating paragraphs of diverse contents is important in many applications. Existing generation models produce similar contents from homogenized contexts due to the fixed left-to-right sentence order. Our idea is permuting the sentence orders to improve the content diversity of multi-sentence paragraph. We propose a novel framework PermGen whose objective is to maximize the expected log-likelihood of output paragraph distributions with respect to all possible sentence orders. PermGen uses hierarchical positional embedding and designs new procedures for training, decoding, and candidate ranking in the sentence-permuted generation. Experiments on three paragraph generation benchmarks demonstrate PermGen generates more diverse outputs with a higher quality than existing models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2017

Generating Sentences by Editing Prototypes

We propose a new generative model of sentences that first samples a prot...
research
08/19/2019

Long and Diverse Text Generation with Planning-based Hierarchical Variational Model

Existing neural methods for data-to-text generation are still struggling...
research
09/04/2021

Pushing Paraphrase Away from Original Sentence: A Multi-Round Paraphrase Generation Approach

In recent years, neural paraphrase generation based on Seq2Seq has achie...
research
09/18/2020

Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models

We report a GPT-based multi-sentence language model for dialogue generat...
research
08/31/2020

Sentence Guided Temporal Modulation for Dynamic Video Thumbnail Generation

We consider the problem of sentence specified dynamic video thumbnail ge...
research
07/23/2018

Influence of Selective Exposure to Viewing Contents Diversity

Personalization, including both self-selected and pre-selected, is inevi...
research
08/13/2018

D-PAGE: Diverse Paraphrase Generation

In this paper, we investigate the diversity aspect of paraphrase generat...

Please sign up or login with your details

Forgot password? Click here to reset