A Study on Efficiency, Accuracy and Document Structure for Answer Sentence Selection

03/04/2020
by   Daniele Bonadiman, et al.
0

An essential task of most Question Answering (QA) systems is to re-rank the set of answer candidates, i.e., Answer Sentence Selection (A2S). These candidates are typically sentences either extracted from one or more documents preserving their natural order or retrieved by a search engine. Most state-of-the-art approaches to the task use huge neural models, such as BERT, or complex attentive architectures. In this paper, we argue that by exploiting the intrinsic structure of the original rank together with an effective word-relatedness encoder, we can achieve competitive results with respect to the state of the art while retaining high efficiency. Our model takes 9.5 seconds to train on the WikiQA dataset, i.e., very fast in comparison with the ∼ 18 minutes required by a standard BERT-base fine-tuning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2022

In Situ Answer Sentence Selection at Web-scale

Current answer sentence selection (AS2) applied in open-domain question ...
research
02/28/2020

DC-BERT: Decoupling Question and Document for Efficient Contextual Encoding

Recent studies on open-domain question answering have achieved prominent...
research
05/18/2019

BERTSel: Answer Selection with Pre-trained Models

Recently, pre-trained models have been the dominant paradigm in natural ...
research
05/21/2018

Efficient and Robust Question Answering from Minimal Context over Documents

Neural models for question answering (QA) over documents have achieved s...
research
08/19/2019

A Study of BERT for Non-Factoid Question-Answering under Passage Length Constraints

We study the use of BERT for non-factoid question-answering, focusing on...
research
01/28/2021

Modeling Context in Answer Sentence Selection Systems on a Latency Budget

Answer Sentence Selection (AS2) is an efficient approach for the design ...
research
04/14/2020

A Simple Yet Strong Pipeline for HotpotQA

State-of-the-art models for multi-hop question answering typically augme...

Please sign up or login with your details

Forgot password? Click here to reset