research
∙
05/22/2023
How do languages influence each other? Studying cross-lingual data sharing during LLM fine-tuning
Multilingual large language models (MLLMs) are jointly trained on data f...
share
research
∙
05/19/2023
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages
Data scarcity is a crucial issue for the development of highly multiling...
research
∙
12/20/2022
Character-Aware Models Improve Visual Text Rendering
Current image generation models struggle to reliably produce well-formed...
research
∙
11/02/2022
Dialect-robust Evaluation of Generated Text
Evaluation metrics that are not robust to dialect variation make it impo...
research
∙
10/31/2022
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks
Large multilingual language models typically share their parameters acro...
research
∙
10/01/2022
FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation
We present FRMT, a new dataset and evaluation benchmark for Few-shot Reg...
research
∙
03/31/2022
Scaling Up Models and Data with and
Recent neural network-based language models have benefited greatly from ...
research
∙
09/14/2021
Frequency Effects on Syntactic Rule Learning in Transformers
Pre-trained language models perform well on a variety of linguistic task...
research
∙
03/11/2021
CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation
Pipelined NLP systems have largely been superseded by end-to-end neural ...
research
∙
10/24/2020
Improving Multilingual Models with Language-Clustered Vocabularies
State-of-the-art multilingual models depend on vocabularies that cover a...
research
∙
03/10/2020
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages
Confidently making progress on multilingual modeling requires challengin...
research
∙
06/04/2019
How multilingual is Multilingual BERT?
In this paper, we show that Multilingual BERT (M-BERT), released by Devl...
research
∙
04/25/2017
Automatic Compositor Attribution in the First Folio of Shakespeare
Compositor attribution, the clustering of pages in a historical printed ...
research
∙
01/15/2017