research
∙
11/07/2022
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers
The attention mechanism is considered the backbone of the widely-used Tr...
share
research
∙
08/31/2021
Sentence Bottleneck Autoencoders from Transformer Language Models
Representation learning for text via pretraining a language model on a l...
research
∙
12/28/2020
Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval
Existing methods for open-retrieval question answering in lower resource...
research
∙
10/06/2020
