Zewen Chi | DeepAI

AI Chat

Featured Co-authors

Qiang Liu
190 publications
Ting Liu
188 publications
Furu Wei
184 publications
Jian Yang
171 publications
Wei Wei
156 publications
Ming Zhou
107 publications
Li Dong
95 publications
Wanxiang Che
84 publications
Nan Yang
70 publications
Shuming Ma
66 publications
Heyan Huang
55 publications

∙ 05/15/2023

Measuring Cross-Lingual Transferability of Multilingual Transformers on Sentence Classification

Recent studies have exhibited remarkable capabilities of pre-trained mul...

0 Zewen Chi, et al. ∙

∙ 02/27/2023

Language Is Not All You Need: Aligning Perception with Language Models

A big convergence of language, multimodal perception, action, and world ...

0 Shaohan Huang, et al. ∙

∙ 12/19/2022

Optimizing Prompts for Text-to-Image Generation

Well-designed prompts can guide text-to-image models to generate amazing...

0 Yaru Hao, et al. ∙

∙ 11/23/2022

TorchScale: Transformers at Scale

Large Transformers have achieved state-of-the-art performance across man...

0 Shuming Ma, et al. ∙

∙ 10/26/2022

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning

In this paper, we elaborate upon recipes for building multilingual repre...

0 Barun Patra, et al. ∙

∙ 08/23/2022

Unsupervised Question Answering via Answer Diversifying

Unsupervised question answering is an attractive task due to its indepen...

4 Yuxiang Nie, et al. ∙

∙ 06/13/2022

Language Models are General-Purpose Interfaces

Foundation models have received much attention due to their effectivenes...

0 Yaru Hao, et al. ∙

∙ 04/20/2022

On the Representation Collapse of Sparse Mixture of Experts

Sparse mixture of experts provides larger model capacity while requiring...

0 Zewen Chi, et al. ∙

∙ 09/23/2021

Cross-Lingual Language Model Meta-Pretraining

The success of pretrained cross-lingual language models relies on two es...

4 Zewen Chi, et al. ∙

∙ 06/30/2021

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA

In this paper, we introduce ELECTRA-style tasks to cross-lingual languag...

0 Zewen Chi, et al. ∙

∙ 06/15/2021

Consistency Regularization for Cross-Lingual Fine-Tuning

Fine-tuning pre-trained cross-lingual language models can transfer task-...

0 Bo Zheng, et al. ∙

∙ 06/11/2021

Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment

The cross-lingual language models are typically pretrained with masked l...

0 Zewen Chi, et al. ∙

∙ 04/18/2021

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs

Multilingual T5 (mT5) pretrains a sequence-to-sequence model on massive ...

0 Zewen Chi, et al. ∙

∙ 01/02/2021

A Robust and Domain-Adaptive Approach for Low-Resource Named Entity Recognition

Recently, it has attracted much attention to build reliable named entity...

0 Houjin Yu, et al. ∙

∙ 12/31/2020

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders

Multilingual machine translation enables a single model to translate bet...

0 Shuming Ma, et al. ∙

∙ 07/15/2020

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

In this work, we formulate cross-lingual language model pre-training as ...

0 Zewen Chi, et al. ∙

∙ 07/03/2020

Generating Informative Dialogue Responses with Keywords-Guided Networks

Recently, open-domain dialogue systems have attracted growing attention....

0 Heng-Da Xu, et al. ∙

∙ 11/10/2019

Can Monolingual Pretrained Models Help Cross-Lingual Classification?

Multilingual pretrained language models (such as multilingual BERT) have...

0 Zewen Chi, et al. ∙

∙ 09/23/2019

Cross-Lingual Natural Language Generation via Pre-Training

In this work we focus on transferring supervision signals of natural lan...

1 Zewen Chi, et al. ∙

∙ 08/13/2019

Complicated Table Structure Recognition

The task of table structure recognition aims to recognize the internal s...

0 Zewen Chi, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world