research
∙
05/15/2023
Measuring Cross-Lingual Transferability of Multilingual Transformers on Sentence Classification
Recent studies have exhibited remarkable capabilities of pre-trained mul...
share
research
∙
02/27/2023
Language Is Not All You Need: Aligning Perception with Language Models
A big convergence of language, multimodal perception, action, and world ...
research
∙
12/19/2022
Optimizing Prompts for Text-to-Image Generation
Well-designed prompts can guide text-to-image models to generate amazing...
research
∙
11/23/2022
TorchScale: Transformers at Scale
Large Transformers have achieved state-of-the-art performance across man...
research
∙
10/26/2022
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
In this paper, we elaborate upon recipes for building multilingual repre...
research
∙
08/23/2022
Unsupervised Question Answering via Answer Diversifying
Unsupervised question answering is an attractive task due to its indepen...
research
∙
06/13/2022
Language Models are General-Purpose Interfaces
Foundation models have received much attention due to their effectivenes...
research
∙
04/20/2022
On the Representation Collapse of Sparse Mixture of Experts
Sparse mixture of experts provides larger model capacity while requiring...
research
∙
09/23/2021
Cross-Lingual Language Model Meta-Pretraining
The success of pretrained cross-lingual language models relies on two es...
research
∙
06/30/2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
In this paper, we introduce ELECTRA-style tasks to cross-lingual languag...
research
∙
06/15/2021
Consistency Regularization for Cross-Lingual Fine-Tuning
Fine-tuning pre-trained cross-lingual language models can transfer task-...
research
∙
06/11/2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment
The cross-lingual language models are typically pretrained with masked l...
research
∙
04/18/2021
mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs
Multilingual T5 (mT5) pretrains a sequence-to-sequence model on massive ...
research
∙
01/02/2021
A Robust and Domain-Adaptive Approach for Low-Resource Named Entity Recognition
Recently, it has attracted much attention to build reliable named entity...
research
∙
12/31/2020
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders
Multilingual machine translation enables a single model to translate bet...
research
∙
07/15/2020
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
In this work, we formulate cross-lingual language model pre-training as ...
research
∙
07/03/2020
Generating Informative Dialogue Responses with Keywords-Guided Networks
Recently, open-domain dialogue systems have attracted growing attention....
research
∙
11/10/2019
Can Monolingual Pretrained Models Help Cross-Lingual Classification?
Multilingual pretrained language models (such as multilingual BERT) have...
research
∙
09/23/2019
Cross-Lingual Natural Language Generation via Pre-Training
In this work we focus on transferring supervision signals of natural lan...
research
∙
08/13/2019