research
∙
07/03/2023
Trainable Transformer in Transformer
Recent works attribute the capability of in-context learning (ICL) in la...
share
research
∙
07/01/2023
InstructEval: Systematic Evaluation of Instruction Selection Methods
In-context learning (ICL) performs tasks by prompting a large language m...
research
∙
12/19/2022
Training Trajectories of Language Models Across Scales
Scaling up language models has led to unprecedented performance gains, b...
research
∙
10/26/2022
MABEL: Attenuating Gender Bias using Textual Entailment Data
Pre-trained language models encode undesirable social biases, which are ...
research
∙
10/26/2022
Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models
Masked language models like BERT can perform text classification in a ze...
research
∙
05/30/2022
Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models
Pre-trained masked language models successfully perform few-shot learnin...
research
∙
04/01/2022
Structured Pruning Learns Compact and Accurate Models
The growing size of neural language models has led to increased attentio...
research
∙
04/26/2021
Non-Parametric Few-Shot Learning for Word Sense Disambiguation
Word sense disambiguation (WSD) is a long-standing problem in natural la...
research
∙
04/16/2021
MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning
The combination of multilingual pre-trained representations and cross-li...
research
∙
05/25/2020
Demoting Racial Bias in Hate Speech Detection
In current hate speech datasets, there exists a high correlation between...
research
∙
05/02/2020
Predicting Performance for Natural Language Processing Tasks
Given the complexity of combinations of tasks, languages, and domains in...
research
∙
04/27/2020
A Summary of the First Workshop on Language Technology for Language Documentation and Revitalization
Despite recent advances in natural language processing and other languag...
research
∙
06/10/2019
Generalized Data Augmentation for Low-Resource Translation
Translation to or from low-resource languages LRLs poses challenges for ...
research
∙
06/02/2019
Domain Adaptation of Neural Machine Translation by Lexicon Induction
It has been previously noted that neural machine translation (NMT) is ve...
research
∙
05/29/2019