research
∙
05/24/2023
Privacy Implications of Retrieval-Based Language Models
Retrieval-based language models (LMs) have demonstrated improved interpr...
share
research
∙
02/21/2023
kNN-Adapter: Efficient Domain Adaptation for Black-Box Language Models
Fine-tuning a language model on a new domain is standard practice for do...
research
∙
05/25/2022
Training Language Models with Memory Augmentation
Recent work has improved language models remarkably by equipping them wi...
research
∙
05/17/2022
Recovering Private Text in Federated Learning of Language Models
Federated learning allows distributed users to collaboratively train a m...
research
∙
04/01/2022
Structured Pruning Learns Compact and Accurate Models
The growing size of neural language models has led to increased attentio...
research
∙
02/16/2022
Should You Mask 15
Masked language models conventionally use a masking rate of 15 belief th...
research
∙
09/17/2021
Simple Entity-Centric Questions Challenge Dense Retrievers
Open-domain question answering has exploded in popularity recently due t...
research
∙
04/12/2021
Factual Probing Is [MASK]: Learning vs. Learning to Recall
Petroni et al. (2019) demonstrated that it is possible to retrieve world...
research
∙
10/24/2020
A Frustratingly Easy Approach for Joint Entity and Relation Extraction
End-to-end relation extraction aims to identify named entities and extra...
research
∙
08/31/2018