research
∙
07/11/2023
Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
Despite the dominance and effectiveness of scaling, resulting in large n...
share
research
∙
05/26/2023
Honey, I Shrunk the Language: Language Model Behavior at Reduced Scale
In recent years, language models have drastically grown in size, and the...
research
∙
04/04/2023
Scalable and Accurate Self-supervised Multimodal Representation Learning without Aligned Video and Text Data
Scaling up weakly-supervised datasets has shown to be highly effective i...
research
∙
03/29/2023
Larger Probes Tell a Different Story: Extending Psycholinguistic Datasets Via In-Context Learning
Language model probing is often used to test specific capabilities of th...
research
∙
03/28/2023
Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning
This paper presents a systematic overview and comparison of parameter-ef...
research
∙
06/06/2022
Learning to Ask Like a Physician
Existing question answering (QA) datasets derived from electronic health...
research
∙
05/21/2022
Life after BERT: What do Other Muppets Understand about Language?
Existing pre-trained transformer analysis works usually focus only on on...
research
∙
10/15/2020
Continual Learning for Neural Semantic Parsing
A semantic parsing model is crucial to natural language processing appli...
research
∙
10/16/2019
