DeepAI AI Chat
Log In Sign Up

Fine-tune the Entire RAG Architecture (including DPR retriever) for Question-Answering

06/22/2021
by   Shamane Siriwardhana, et al.
0

In this paper, we illustrate how to fine-tune the entire Retrieval Augment Generation (RAG) architecture in an end-to-end manner. We highlighted the main engineering challenges that needed to be addressed to achieve this objective. We also compare how end-to-end RAG architecture outperforms the original RAG architecture for the task of question answering. We have open-sourced our implementation in the HuggingFace Transformers library.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/05/2019

End-to-End Open-Domain Question Answering with BERTserini

We demonstrate an end-to-end question answering system that integrates B...
12/02/2014

Watsonsim: Overview of a Question Answering Engine

The objective of the project is to design and run a system similar to Wa...
04/12/2021

A Replication Study of Dense Passage Retriever

Text retrieval using learned dense representations has recently emerged ...
03/02/2022

Recent, rapid advancement in visual question answering architecture: a review

Understanding visual question answering is going to be crucial for numer...
07/03/2020

Eliminating Catastrophic Interference with Biased Competition

We present here a model to take advantage of the multi-task nature of co...
07/30/2020

The Making of 5G: Building an End-to-End 5G-Enabled System

This article documents one of the world's first standards-compliant pre-...
09/11/2018

Answering Visual What-If Questions: From Actions to Predicted Scene Descriptions

In-depth scene descriptions and question answering tasks have greatly in...