ForecastQA: Machine Comprehension of Temporal Text for Answering Forecasting Questions

05/02/2020
by   Woojeong Jin, et al.
12

Textual data are often accompanied by time information (e.g., dates in news articles), but the information is easily overlooked on existing question answering datasets. In this paper, we introduce ForecastQA, a new open-domain question answering dataset consisting of 10k questions which requires temporal reasoning. ForecastQA is collected via a crowdsourcing effort based on news articles, where workers were asked to come up with yes-no or multiple-choice questions. We also present baseline models for our dataset, which is based on a pre-trained language model. In our study, our baseline model achieves 61.6 accuracy on the ForecastQA dataset. We expect that our new data will support future research efforts. Our data and code are publicly available at https://inklab.usc.edu/ForecastQA/.

READ FULL TEXT

page 5

page 6

research
06/16/2016

SQuAD: 100,000+ Questions for Machine Comprehension of Text

We present the Stanford Question Answering Dataset (SQuAD), a new readin...
research
02/08/2022

NEWSKVQA: Knowledge-Aware News Video Question Answering

Answering questions in the context of videos can be helpful in video ind...
research
07/01/2019

Katecheo: A Portable and Modular System for Multi-Topic Question Answering

We introduce a modular system that can be deployed on any Kubernetes clu...
research
05/23/2022

StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models

Knowledge and language understanding of models evaluated through questio...
research
09/19/2020

Can questions summarize a corpus? Using question generation for characterizing COVID-19 research

What are the latent questions on some textual data? In this work, we inv...
research
08/20/2019

GeoSQA: A Benchmark for Scenario-based Question Answering in the Geography Domain at High School Level

Scenario-based question answering (SQA) has attracted increasing researc...
research
04/17/2019

Headline Generation: Learning from Decomposable Document Titles

We propose a novel method for generating titles for unstructured text do...

Please sign up or login with your details

Forgot password? Click here to reset