research
∙
09/11/2023
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
The Mixture of Experts (MoE) is a widely known neural architecture where...
share
research
∙
09/08/2023
When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale
Large volumes of text data have contributed significantly to the develop...
research
∙
05/30/2023
Intriguing Properties of Quantization at Scale
Emergent properties have been widely adopted as a term to describe behav...
research
∙
05/24/2022
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer
Massively multilingual models are promising for transfer learning across...
research
∙
05/23/2022
When does Parameter-Efficient Transfer Learning Work for Machine Translation?
Parameter-efficient fine-tuning methods (PEFTs) offer the promise of ada...
research
∙
10/20/2021
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters
We consider the problem of multilingual unsupervised machine translation...
research
∙
09/24/2021
Unsupervised Translation of German–Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language
This paper describes the methods behind the systems submitted by the Uni...
research
∙
07/13/2021
On the Difficulty of Translating Free-Order Case-Marking Languages
Identifying factors that make certain languages harder to model than oth...
research
∙
05/15/2021
From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding
The lack of publicly available evaluation data for low-resource language...
research
∙
03/01/2021
On the Effectiveness of Dataset Embeddings in Mono-lingual,Multi-lingual and Zero-shot Conditions
Recent complementary strands of research have shown that leveraging info...
research
∙
07/24/2020
FiSSA at SemEval-2020 Task 9: Fine-tuned For Feelings
In this paper, we present our approach for sentiment classification on S...
research
∙
05/29/2020
Massive Choice, Ample Tasks (MaChAmp):A Toolkit for Multi-task Learning in NLP
Transfer learning, particularly approaches that combine multi-task learn...
research
∙
04/29/2020
UDapter: Language Adaptation for Truly Universal Dependency Parsing
Recent advances in the field of multilingual dependency parsing have bro...
research
∙
04/24/2017
A Trie-Structured Bayesian Model for Unsupervised Morphological Segmentation
In this paper, we introduce a trie-structured Bayesian model for unsuper...
research
∙
03/09/2017