Deriving Commonsense Inference Tasks from Interactive Fictions

10/19/2020
by   Mo Yu, et al.
0

Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an indispensable cornerstone in building general AI systems. We propose a new commonsense reasoning dataset based on human's interactive fiction game playings as human players demonstrate plentiful and diverse commonsense reasoning. The new dataset mitigates several limitations of the prior art. Experiments show that our task is solvable to human experts with sufficient commonsense knowledge but poses challenges to existing machine reading models, with a big performance gap of more than 30

READ FULL TEXT
research
06/06/2019

Explain Yourself! Leveraging Language Models for Commonsense Reasoning

Deep learning models perform poorly on tasks that require commonsense re...
research
09/11/2020

An Atlas of Cultural Commonsense for Machine Reasoning

Existing commonsense reasoning datasets for AI and NLP tasks fail to add...
research
07/25/2022

WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models

While vision-and-language models perform well on tasks such as visual qu...
research
09/19/2023

An Evaluation of GPT-4 on the ETHICS Dataset

This report summarizes a short study of the performance of GPT-4 on the ...
research
07/16/2023

Recognition of Mental Adjectives in An Efficient and Automatic Style

In recent years, commonsense reasoning has received more and more attent...
research
03/24/2021

UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark

Commonsense AI has long been seen as a near impossible goal – until rece...
research
09/25/2016

Commonsense reasoning, commonsense knowledge, and the SP theory of intelligence

This paper describes how the "SP theory of intelligence", outlined in an...

Please sign up or login with your details

Forgot password? Click here to reset