A Survey for Efficient Open Domain Question Answering

11/15/2022
by   Qin Zhang, et al.
16

Open domain question answering (ODQA) is a longstanding task aimed at answering factual questions from a large knowledge corpus without any explicit evidence in natural language processing (NLP). Recent works have predominantly focused on improving the answering accuracy and achieved promising progress. However, higher accuracy often comes with more memory consumption and inference latency, which might not necessarily be efficient enough for direct deployment in the real world. Thus, a trade-off between accuracy, memory consumption and processing speed is pursued. In this paper, we provide a survey of recent advances in the efficiency of ODQA models. We walk through the ODQA models and conclude the core techniques on efficiency. Quantitative analysis on memory cost, processing speed, accuracy and overall comparison are given. We hope that this work would keep interested scholars informed of the advances and open challenges in ODQA efficiency research, and thus contribute to the further development of ODQA efficiency.

READ FULL TEXT
research
01/04/2021

Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering

Open-domain Question Answering (OpenQA) is an important task in Natural ...
research
04/15/2022

Characterizing the Efficiency vs. Accuracy Trade-off for Long-Context NLP Models

With many real-world applications of Natural Language Processing (NLP) c...
research
06/08/2023

Mapping the Challenges of HCI: An Application and Evaluation of ChatGPT and GPT-4 for Cost-Efficient Question Answering

Large language models (LLMs), such as ChatGPT and GPT-4, are gaining wid...
research
07/19/2023

Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation

Rising computational demands of modern natural language processing (NLP)...
research
05/18/2023

Visual Question Answering: A Survey on Techniques and Common Trends in Recent Literature

Visual Question Answering (VQA) is an emerging area of interest for rese...
research
05/22/2023

Beyond Words: A Comprehensive Survey of Sentence Representations

Sentence representations have become a critical component in natural lan...
research
06/09/2021

What Would a Teacher Do? Predicting Future Talk Moves

Recent advances in natural language processing (NLP) have the ability to...

Please sign up or login with your details

Forgot password? Click here to reset