research
∙
08/28/2023
MEMORY-VQ: Compression for Tractable Internet-Scale Memory
Retrieval augmentation is a powerful but expensive method to make langua...
share
research
∙
06/17/2023
GLIMMER: generalized late-interaction memory reranker
Memory-augmentation is a powerful approach for efficiently incorporating...
research
∙
05/22/2023
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Multi-query attention (MQA), which only uses a single key-value head, dr...
research
∙
03/17/2023
CoLT5: Faster Long-Range Transformers with Conditional Computation
Many natural language processing tasks benefit from long inputs, but pro...
research
∙
01/25/2023
Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute
Retrieval-augmented language models such as Fusion-in-Decoder are powerf...
research
∙
12/15/2022
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference
Fusion-in-Decoder (FiD) is a powerful retrieval-augmented language model...
research
∙
09/29/2022
Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing
A common recent approach to semantic parsing augments sequence-to-sequen...
research
∙
07/01/2022
QA Is the New KR: Question-Answer Pairs as Knowledge Bases
In this position paper, we propose a new approach to generating a type o...
research
∙
04/10/2022
Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answering
Retrieval augmented language models have recently become the standard fo...
research
∙
10/12/2021
Mention Memory: incorporating textual knowledge into Transformers through entity mention attention
Natural language understanding tasks such as open-domain question answer...
research
∙
06/03/2021
Grounding Complex Navigational Instructions Using Scene Graphs
Training a reinforcement learning agent to carry out natural language in...
research
∙
05/10/2021
ReadTwice: Reading Very Large Documents with Memories
Knowledge-intensive tasks such as question answering often require assim...
research
∙
06/17/2019
Neural Theorem Provers Do Not Learn Rules Without Exploration
Neural symbolic processing aims to combine the generalization of logical...
research
∙
12/05/2018