QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questions

09/08/2019
by   Oyvind Tafjord, et al.
0

We introduce the first open-domain dataset, called QuaRTz, for reasoning about textual qualitative relationships. QuaRTz contains general qualitative statements, e.g., "A sunscreen with a higher SPF protects the skin longer.", twinned with 3864 crowdsourced situated questions, e.g., "Billy is wearing sunscreen with a lower SPF than Lucy. Who will be best protected from the sun?", plus annotations of the properties being compared. Unlike previous datasets, the general knowledge is textual and not tied to a fixed set of relationships, and tests a system's ability to comprehend and apply textual qualitative knowledge in a novel setting. We find state-of-the-art results are substantially (20 the NLP community.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2018

QuaRel: A Dataset and Models for Answering Questions about Qualitative Relationships

Many natural language questions require recognizing and reasoning with q...
research
01/30/2013

Incremental Tradeoff Resolution in Qualitative Probabilistic Networks

Qualitative probabilistic reasoning in a Bayesian network often reveals ...
research
09/28/2020

Joint Spatio-Textual Reasoning for Answering Tourism Questions

Our goal is to answer real-world tourism questions that seek Points-of-I...
research
10/06/2020

Universal Natural Language Processing with Limited Annotations: Try Few-shot Textual Entailment as a Start

A standard way to address different NLP problems is by first constructin...
research
09/10/2019

WIQA: A dataset for "What if..." reasoning over procedural text

We introduce WIQA, the first large-scale dataset of "What if..." questio...
research
11/09/2019

The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents

We introduce dodecaDialogue: a set of 12 tasks that measures if a conver...
research
08/20/2021

Extracting Qualitative Causal Structure with Transformer-Based NLP

Qualitative causal relationships compactly express the direction, depend...

Please sign up or login with your details

Forgot password? Click here to reset