Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering

by   Hao Cheng, et al.

We address the problem of extractive question answering using document-level distant super-vision, pairing questions and relevant documents with answer strings. We compare previously used probability space and distant super-vision assumptions (assumptions on the correspondence between the weak answer string labels and possible answer mention spans). We show that these assumptions interact, and that different configurations provide complementary benefits. We demonstrate that a multi-objective model can efficiently combine the advantages of multiple assumptions and out-perform the best individual formulation. Our approach outperforms previous state-of-the-art models by 4.3 points in F1 on TriviaQA-Wiki and 1.7 points in Rouge-L on NarrativeQA summaries.


page 1

page 2

page 3

page 4


Dynamic Coattention Networks For Question Answering

Several deep learning models have been proposed for question answering. ...

UnitedQA: A Hybrid Approach for Open Domain Question Answering

To date, most of recent work under the retrieval-reader framework for op...

Document Collection Visual Question Answering

Current tasks and methods in Document Understanding aims to process docu...

Guiding Extractive Summarization with Question-Answering Rewards

Highlighting while reading is a natural behavior for people to track sal...

RikiNet: Reading Wikipedia Pages for Natural Question Answering

Reading long documents to answer open-domain questions remains challengi...

Frustratingly Easy Natural Question Answering

Existing literature on Question Answering (QA) mostly focuses on algorit...

Rethinking the objectives of extractive question answering

This paper describes two generally applicable approaches towards the sig...