Automatic Knowledge Augmentation for Generative Commonsense Reasoning

10/30/2021
by   Jaehyung Seo, et al.
0

Generative commonsense reasoning is the capability of a language model to generate a sentence with a given concept-set that is based on commonsense knowledge. However, generative language models still struggle to provide outputs, and the training set does not contain patterns that are sufficient for generative commonsense reasoning. In this paper, we propose a data-centric method that uses automatic knowledge augmentation to extend commonsense knowledge using a machine knowledge generator. This method can generate semi-golden sentences that improve the generative commonsense reasoning of a language model without architecture modifications. Furthermore, this approach is a model-agnostic method and does not require human effort for data construction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/16/2021

Commonsense Knowledge-Augmented Pretrained Language Models for Causal Reasoning Classification

Commonsense knowledge can be leveraged for identifying causal relations ...
research
03/14/2022

Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts

Generative commonsense reasoning (GCR) in natural language is to reason ...
research
06/22/2023

Mapping and Cleaning Open Commonsense Knowledge Bases with Generative Translation

Structured knowledge bases (KBs) are the backbone of many know­ledge-int...
research
10/02/2022

Does Wikidata Support Analogical Reasoning?

Analogical reasoning methods have been built over various resources, inc...
research
06/16/2022

PInKS: Preconditioned Commonsense Inference with Minimal Supervision

Reasoning with preconditions such as "glass can be used for drinking wat...
research
11/10/2015

From Images to Sentences through Scene Description Graphs using Commonsense Reasoning and Knowledge

In this paper we propose the construction of linguistic descriptions of ...
research
06/22/2023

From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought

How does language inform our downstream thinking? In particular, how do ...

Please sign up or login with your details

Forgot password? Click here to reset