The Web as a Knowledge-base for Answering Complex Questions

03/18/2018
by   Alon Talmor, et al.
0

Answering complex questions is a time-consuming activity for humans that requires reasoning and integration of information. Recent work on reading comprehension made headway in answering simple questions, but tackling complex questions is still an ongoing research challenge. Conversely, semantic parsers have been successful at handling compositionality, but only when the information resides in a target knowledge-base. In this paper, we present a novel framework for answering broad and complex questions, assuming answering simple questions is possible using a search engine and a reading comprehension model. We propose to decompose complex questions into a sequence of simple questions, and compute the final answer from the sequence of answers. To illustrate the viability of our approach, we create a new dataset of complex questions, ComplexWebQuestions, and present a model that decomposes questions and interacts with the web to compute an answer. We empirically demonstrate that question decomposition improves performance from 20.8 precision@1 to 27.5 precision@1 on this new dataset.

READ FULL TEXT

page 5

page 14

research
09/12/2018

Knowledge Based Machine Reading Comprehension

Machine reading comprehension (MRC) requires reasoning about both the kn...
research
07/25/2018

Repartitioning of the ComplexWebQuestions Dataset

Recently, Talmor and Berant (2018) introduced ComplexWebQuestions - a da...
research
06/26/2021

Answering Chinese Elementary School Social Study Multiple Choice Questions

We present a novel approach to answer the Chinese elementary school Soci...
research
06/07/2023

Knowing-how Knowing-that: A New Task for Machine Reading Comprehension of User Manuals

The machine reading comprehension (MRC) of user manuals has huge potenti...
research
06/01/2018

A Systematic Classification of Knowledge, Reasoning, and Context within the ARC Dataset

The recent work of Clark et al. introduces the AI2 Reasoning Challenge (...
research
07/01/2019

Katecheo: A Portable and Modular System for Multi-Topic Question Answering

We introduce a modular system that can be deployed on any Kubernetes clu...
research
12/20/2022

When Do Decompositions Help for Machine Reading?

Answering complex questions often requires multi-step reasoning in order...

Please sign up or login with your details

Forgot password? Click here to reset