Understanding Few-Shot Commonsense Knowledge Models

01/01/2021
by   Jeff Da, et al.
0

Providing natural language processing systems with commonsense knowledge is a critical challenge for achieving language understanding. Recently, commonsense knowledge models have emerged as a suitable approach for hypothesizing situation-relevant commonsense knowledge on-demand in natural language applications. However, these systems are limited by the fixed set of relations captured by schemas of the knowledge bases on which they're trained. To address this limitation, we investigate training commonsense knowledge models in a few-shot setting with limited tuples per commonsense relation in the graph. We perform five separate studies on different dimensions of few-shot commonsense knowledge learning, providing a roadmap on best practices for training these systems efficiently. Importantly, we find that human quality ratings for knowledge produced from a few-shot trained system can achieve performance within 6 few-shot performance enables coverage of a wide breadth of relations in future commonsense systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2021

How Commonsense Knowledge Helps with Natural Language Tasks: A Survey of Recent Resources and Methodologies

In this paper, we give an overview of commonsense reasoning in natural l...
research
01/12/2021

Dimensions of Commonsense Knowledge

Commonsense knowledge is essential for many AI applications, including t...
research
02/01/2021

Commonsense Knowledge Mining from Term Definitions

Commonsense knowledge has proven to be beneficial to a variety of applic...
research
10/23/2022

ComFact: A Benchmark for Linking Contextual Commonsense Knowledge

Understanding rich narratives, such as dialogues and stories, often requ...
research
04/07/2020

Inferential Text Generation with Multiple Knowledge Sources and Meta-Learning

We study the problem of generating inferential texts of events for a var...
research
11/22/2022

Visually Grounded Commonsense Knowledge Acquisition

Large-scale commonsense knowledge bases empower a broad range of AI appl...
research
10/03/2022

Understanding Substructures in Commonsense Relations in ConceptNet

Acquiring commonsense knowledge and reasoning is an important goal in mo...

Please sign up or login with your details

Forgot password? Click here to reset