research
∙
06/02/2023
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer
Massively multilingual Transformers (MMTs), such as mBERT and XLM-R, are...
share
research
∙
02/22/2023
Modular Deep Learning
Transfer learning has recently become the dominant paradigm of machine l...
research
∙
01/31/2022
Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation
Multilingual task-oriented dialogue (ToD) facilitates access to services...
research
∙
10/14/2021
Composable Sparse Fine-Tuning for Cross-Lingual Transfer
Fine-tuning all parameters of a pre-trained model has become the mainstr...
research
∙
08/06/2021
Towards Zero-shot Language Modeling
Can we construct a neural model that is inductively biased towards learn...
research
∙
07/23/2021
Modelling Latent Translations for Cross-Lingual Transfer
While achieving state-of-the-art results in multiple tasks and languages...
research
∙
06/02/2021
Minimax and Neyman-Pearson Meta-Learning for Outlier Languages
Model-agnostic meta-learning (MAML) has been recently put forth as a str...
research
∙
02/10/2021
Differentiable Generative Phonology
The goal of generative phonology, as formulated by Chomsky and Halle (19...
research
∙
10/12/2020
Probing Pretrained Language Models for Lexical Semantics
The success of large pretrained language models (LMs) such as BERT and R...
research
∙
05/01/2020
XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
In order to simulate human language capacity, natural language processin...
research
∙
04/08/2020
Internal and external pressures on language emergence: least effort, object constancy and frequency
In previous work, artificial agents were shown to achieve almost perfect...
research
∙
03/10/2020
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity
We introduce Multi-SimLex, a large-scale lexical resource and evaluation...
research
∙
09/05/2019
Informing Unsupervised Pretraining with External Linguistic Knowledge
Unsupervised pretraining models have been shown to facilitate a wide ran...
research
∙
09/11/2018
Adversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specialization
Semantic specialization is the process of fine-tuning pre-trained distri...
research
∙
07/02/2018
Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing
Addressing the cross-lingual variation of grammatical structures and mea...
research
∙
05/17/2017
Decoding Sentiment from Distributed Representations of Sentences
Distributed representations of sentences have been developed recently to...
research
∙
10/03/2016
