QUADRo: Dataset and Models for QUestion-Answer Database Retrieval

03/30/2023
by   Stefano Campese, et al.
0

An effective paradigm for building Automated Question Answering systems is the re-use of previously answered questions, e.g., for FAQs or forum applications. Given a database (DB) of question/answer (q/a) pairs, it is possible to answer a target question by scanning the DB for similar questions. In this paper, we scale this approach to open domain, making it competitive with other standard methods, e.g., unstructured document or graph based. For this purpose, we (i) build a large scale DB of 6.3M q/a pairs, using public questions, (ii) design a new system based on neural IR and a q/a pair reranker, and (iii) construct training and test data to perform comparative experiments with our models. We demonstrate that Transformer-based models using (q,a) pairs outperform models only based on question representation, for both neural search and reranking. Additionally, we show that our DB-based approach is competitive with Web-based methods, i.e., a QA system built on top the BING search engine, demonstrating the challenge of finding relevant information. Finally, we make our data and models available for future research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/23/2019

A Question-Entailment Approach to Question Answering

One of the challenges in large-scale information retrieval (IR) is to de...
research
09/14/2021

Will this Question be Answered? Question Filtering via Answer Model Distillation for Efficient Question Answering

In this paper we propose a novel approach towards improving the efficien...
research
04/18/2017

SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine

We publicly release a new large-scale dataset, called SearchQA, for mach...
research
11/12/2016

Training IBM Watson using Automatically Generated Question-Answer Pairs

IBM Watson is a cognitive computing system capable of question answering...
research
01/31/2018

Complex Sequential Question Answering: Towards Learning to Converse Over Linked Question Answer Pairs with a Knowledge Graph

While conversing with chatbots, humans typically tend to ask many questi...
research
09/08/2019

Large Scale Question Answering using Tourism Data

Real world question answering can be significantly more complex than wha...
research
05/31/2022

Neural Retriever and Go Beyond: A Thesis Proposal

Information Retriever (IR) aims to find the relevant documents (e.g. sni...

Please sign up or login with your details

Forgot password? Click here to reset