Joint Models for Answer Verification in Question Answering Systems

07/09/2021
by   Zeyu Zhang, et al.
12

This paper studies joint models for selecting correct answer sentences among the top k provided by answer sentence selection (AS2) modules, which are core components of retrieval-based Question Answering (QA) systems. Our work shows that a critical step to effectively exploit an answer set regards modeling the interrelated information between pair of answers. For this purpose, we build a three-way multi-classifier, which decides if an answer supports, refutes, or is neutral with respect to another one. More specifically, our neural architecture integrates a state-of-the-art AS2 model with the multi-classifier, and a joint layer connecting all components. We tested our models on WikiQA, TREC-QA, and a real-world dataset. The results show that our models obtain the new state of the art in AS2.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2023

Learning Answer Generation using Supervision from Automatic Question Answering Evaluators

Recent studies show that sentence-level extractive QA, i.e., based on An...
research
01/16/2022

Double Retrieval and Ranking for Accurate Question Answering

Recent work has shown that an answer verification step introduced in Tra...
research
01/16/2022

In Situ Answer Sentence Selection at Web-scale

Current answer sentence selection (AS2) applied in open-domain question ...
research
04/17/2021

Joint Passage Ranking for Diverse Multi-Answer Retrieval

We study multi-answer retrieval, an under-explored problem that requires...
research
10/15/2021

ContraQA: Question Answering under Contradicting Contexts

With a rise in false, inaccurate, and misleading information in propagan...
research
04/09/2019

Quizbowl: The Case for Incremental Question Answering

Quizbowl is a scholastic trivia competition that tests human knowledge a...
research
03/22/2021

Mitigating False-Negative Contexts in Multi-document QuestionAnswering with Retrieval Marginalization

Question Answering (QA) tasks requiring information from multiple docume...

Please sign up or login with your details

Forgot password? Click here to reset