RankQA: Neural Question Answering with Answer Re-Ranking

06/07/2019
by   Bernhard Kratzwald, et al.
0

The conventional paradigm in neural question answering (QA) for narrative content is limited to a two-stage process: first, relevant text passages are retrieved and, subsequently, a neural network for machine comprehension extracts the likeliest answer. However, both stages are largely isolated in the status quo and, hence, information from the two phases is never properly fused. In contrast, this work proposes RankQA: RankQA extends the conventional two-stage process in neural QA with a third stage that performs an additional answer re-ranking. The re-ranking leverages different features that are directly extracted from the QA pipeline, i.e., a combination of retrieval and comprehension features. While our intentionally simple design allows for an efficient, data-sparse estimation, it nevertheless outperforms more complex QA systems by a significant margin: in fact, RankQA achieves state-of-the-art performance on 3 out of 4 benchmark datasets. Furthermore, its performance is especially superior in settings where the size of the corpus is dynamic. Here the answer re-ranking provides an effective remedy against the underlying noise-information trade-off due to a variable corpus size. As a consequence, RankQA represents a novel, powerful, and thus challenging baseline for future research in content-based QA.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/02/2020

Revisiting the Open-Domain Question Answering Pipeline

Open-domain question answering (QA) is the tasl of identifying answers t...
research
08/27/2019

Incremental Improvement of a Question Answering System by Re-ranking Answer Candidates using Machine Learning

We implement a method for re-ranking top-10 results of a state-of-the-ar...
research
08/31/2017

R^3: Reinforced Reader-Ranker for Open-Domain Question Answering

In recent years researchers have achieved considerable success applying ...
research
03/26/2017

Question Answering from Unstructured Text by Retrieval and Comprehension

Open domain Question Answering (QA) systems must interact with external ...
research
10/10/2017

Learning to Rank Question-Answer Pairs using Hierarchical Recurrent Encoder with Latent Topic Clustering

In this paper, we propose a novel end-to-end neural architecture for ran...
research
09/20/2023

Localize, Retrieve and Fuse: A Generalized Framework for Free-Form Question Answering over Tables

Question answering on tabular data (a.k.a TableQA), which aims at genera...

Please sign up or login with your details

Forgot password? Click here to reset