Frustratingly Hard Evidence Retrieval for QA Over Books

07/20/2020
by   Xiangyang Mou, et al.
0

A lot of progress has been made to improve question answering (QA) in recent years, but the special problem of QA over narrative book stories has not been explored in-depth. We formulate BookQA as an open-domain QA task given its similar dependency on evidence retrieval. We further investigate how state-of-the-art open-domain QA approaches can help BookQA. Besides achieving state-of-the-art on the NarrativeQA benchmark, our study also reveals the difficulty of evidence retrieval in books with a wealth of experiments and analysis - which necessitates future effort on novel solutions for evidence retrieval in BookQA.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/07/2021

Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study

Recent advancements in open-domain question answering (ODQA), i.e., find...
research
01/06/2021

SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering

Although open-domain question answering (QA) draws great attention in re...
research
09/22/2020

Using the Hammer Only on Nails: A Hybrid Method for Evidence Retrieval for Question Answering

Evidence retrieval is a key component of explainable question answering ...
research
06/01/2019

Latent Retrieval for Weakly Supervised Open Domain Question Answering

Recent work on open domain question answering (QA) assumes strong superv...
research
05/04/2020

Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answering

Evidence retrieval is a critical stage of question answering (QA), neces...
research
09/08/2021

R2-D2: A Modular Baseline for Open-Domain Question Answering

This work presents a novel four-stage open-domain QA pipeline R2-D2 (Ran...
research
10/21/2020

Is Retriever Merely an Approximator of Reader?

The state of the art in open-domain question answering (QA) relies on an...

Please sign up or login with your details

Forgot password? Click here to reset