research
∙
04/24/2023
On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research
Perception of toxicity evolves over time and often differs between geogr...
share
research
∙
12/20/2022
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training
Prior work has shown that it is possible to expand pretrained Masked Lan...
research
∙
11/16/2022
Task-aware Retrieval with Instructions
We study the problem of retrieval with instructions, where users of a re...
research
∙
09/27/2022
EditEval: An Instruction-Based Benchmark for Text Improvements
Evaluation of text generation to date has primarily focused on content c...
research
∙
08/24/2022
PEER: A Collaborative Language Model
Textual content is often the output of a collaborative writing process: ...
research
∙
08/05/2022
Few-shot Learning with Retrieval Augmented Language Models
Large language models have shown impressive few-shot results on a wide r...
research
∙
07/08/2022
Improving Wikipedia Verifiability with AI
Verifiability is a core content policy of Wikipedia: claims that are lik...
research
∙
04/22/2022
Autoregressive Search Engines: Generating Substrings as Document Identifiers
Knowledge-intensive language tasks require NLP systems to both provide t...
research
∙
03/14/2022
Reasoning over Public and Private Data in Retrieval-Based Systems
Users and organizations are generating ever-increasing amounts of privat...
research
∙
12/18/2021
The Web Is Your Oyster – Knowledge-Intensive NLP against a Very Large Web Corpus
In order to address the increasing demands of real-world applications, t...
research
∙
12/14/2021
Boosted Dense Retriever
We propose DrBoost, a dense retrieval ensemble inspired by boosting. DrB...
research
∙
10/13/2021
Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One?
Despite their recent popularity and well known advantages, dense retriev...
research
∙
10/08/2021
A Few More Examples May Be Worth Billions of Parameters
We investigate the dynamics of increasing the number of model parameters...
research
∙
09/02/2021
Challenges in Generalization in Open Domain Question Answering
Recent work on Open Domain Question Answering has shown that there is a ...
research
∙
07/28/2021
Domain-matched Pre-training Tasks for Dense Retrieval
Pre-training on larger datasets with ever increasing model size is now a...
research
∙
02/13/2021
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them
Open-domain Question Answering models which directly leverage question-a...
research
∙
01/01/2021
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned
We review the EfficientQA competition from NeurIPS 2020. The competition...
research
∙
09/27/2020
Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval
We propose a simple and efficient multi-hop dense retrieval approach for...
research
∙
09/04/2020
KILT: a Benchmark for Knowledge Intensive Language Tasks
Challenging problems such as open-domain question answering, fact checki...
research
∙
08/06/2020
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets
Ideally Open-Domain Question Answering models should exhibit a number of...
research
∙
05/22/2020
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Large pre-trained language models have been shown to store factual knowl...
research
∙
05/10/2020
How Context Affects Language Models' Factual Predictions
When pre-trained on large unsupervised textual corpora, language models ...
research
∙
02/22/2020
Unsupervised Question Decomposition for Question Answering
We aim to improve question answering (QA) by decomposing hard questions ...
research
∙
10/16/2019
MLQA: Evaluating Cross-lingual Extractive Question Answering
Question answering (QA) models have shown rapid progress enabled by the ...
research
∙
09/03/2019
Language Models as Knowledge Bases?
Recent progress in pretraining language models on large textual corpora ...
research
∙
06/12/2019
Unsupervised Question Answering by Cloze Translation
Obtaining training data for Question Answering (QA) is time-consuming an...
research
∙
08/28/2018