Improving Neural Story Generation by Targeted Common Sense Grounding

08/26/2019
by   Huanru Henry Mao, et al.
0

Stories generated with neural language models have shown promise in grammatical and stylistic consistency. However, the generated stories are still lacking in common sense reasoning, e.g., they often contain sentences deprived of world knowledge. We propose a simple multi-task learning scheme to achieve quantitatively better common sense reasoning in language models by leveraging auxiliary training signals from datasets designed to provide common sense grounding. When combined with our two-stage fine-tuning pipeline, our method achieves improved common sense reasoning and state-of-the-art perplexity on the Writing Prompts (Fan et al., 2018) story generation dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/12/2021

Contextualized Scene Imagination for Generative Commonsense Reasoning

Humans use natural language to compose common concepts from their enviro...
research
10/11/2020

Do Language Embeddings Capture Scales?

Pretrained Language Models (LMs) have been shown to possess significant ...
research
04/20/2023

A genuinely untyped solution to the knower paradoxes

Kaplan and Montague have showed that certain intuitive axioms for a firs...
research
10/17/2020

Consistency and Coherency Enhanced Story Generation

Story generation is a challenging task, which demands to maintain consis...
research
10/02/2018

A Knowledge Hunting Framework for Common Sense Reasoning

We introduce an automatic system that achieves state-of-the-art results ...
research
11/27/2021

Common Sense Knowledge Learning for Open Vocabulary Neural Reasoning: A First View into Chronic Disease Literature

In this paper, we address reasoning tasks from open vocabulary Knowledge...
research
11/05/2018

On the Evaluation of Common-Sense Reasoning in Natural Language Understanding

The NLP and ML communities have long been interested in developing model...

Please sign up or login with your details

Forgot password? Click here to reset