Double Retrieval and Ranking for Accurate Question Answering

01/16/2022
by   Zeyu Zhang, et al.
3

Recent work has shown that an answer verification step introduced in Transformer-based answer selection models can significantly improve the state of the art in Question Answering. This step is performed by aggregating the embeddings of top k answer candidates to support the verification of a target answer. Although the approach is intuitive and sound still shows two limitations: (i) the supporting candidates are ranked only according to the relevancy with the question and not with the answer, and (ii) the support provided by the other answer candidates is suboptimal as these are retrieved independently of the target answer. In this paper, we address both drawbacks by proposing (i) a double reranking model, which, for each target answer, selects the best support; and (ii) a second neural retrieval stage designed to encode question and answer pair as the query, which finds more specific verification information. The results on three well-known datasets for AS2 show consistent and significant improvement of the state of the art.

READ FULL TEXT
research
07/09/2021

Joint Models for Answer Verification in Question Answering Systems

This paper studies joint models for selecting correct answer sentences a...
research
12/18/2018

Partial Verification as a Substitute for Money

Recent work shows that we can use partial verification instead of money ...
research
08/27/2019

Incremental Improvement of a Question Answering System by Re-ranking Answer Candidates using Machine Learning

We implement a method for re-ranking top-10 results of a state-of-the-ar...
research
10/23/2022

Knowledge Transfer from Answer Ranking to Answer Generation

Recent studies show that Question Answering (QA) based on Answer Sentenc...
research
04/17/2023

A Question-Answering Approach to Key Value Pair Extraction from Form-like Document Images

In this paper, we present a new question-answering (QA) based key-value ...
research
04/17/2021

Joint Passage Ranking for Diverse Multi-Answer Retrieval

We study multi-answer retrieval, an under-explored problem that requires...
research
10/10/2020

MS-Ranker: Accumulating Evidence from Potentially Correct Candidates for Answer Selection

As conventional answer selection (AS) methods generally match the questi...

Please sign up or login with your details

Forgot password? Click here to reset