Shijie Wu | DeepAI

DeepAI AI Chat

Featured Co-authors

Mohit Bansal
184 publications
Luke Zettlemoyer
160 publications
Ryan Cotterell
156 publications
Benjamin Van Durme
102 publications
Antonios Anastasopoulos
66 publications
Genta Indra Winata
58 publications
Haoran Li
51 publications
Adina Williams
41 publications
Tiago Pimentel
40 publications
Mark Dredze
39 publications
Sebastian Gehrmann
38 publications

∙ 05/26/2023

MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies

Autoregressive language models are trained by minimizing the cross-entro...

1 Shiyue Zhang, et al. ∙

∙ 05/25/2023

Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning

Real-life multilingual systems should be able to efficiently incorporate...

0 Genta Indra Winata, et al. ∙

∙ 03/30/2023

BloombergGPT: A Large Language Model for Finance

The use of NLP in the realm of financial technology is broad and complex...

0 Shijie Wu, et al. ∙

∙ 10/10/2022

BoundaryFace: A mining framework with noise label self-correction for Face Recognition

Face recognition has made tremendous progress in recent years due to the...

0 Shijie Wu, et al. ∙

∙ 07/12/2022

How Do Multilingual Encoders Learn Cross-lingual Representation?

NLP systems typically require support for more than one language. As dif...

0 Shijie Wu, et al. ∙

∙ 07/12/2022

Zero-shot Cross-lingual Transfer is Under-specified Optimization

Pretrained multilingual encoders enable zero-shot cross-lingual transfer...

0 Shijie Wu, et al. ∙

∙ 09/14/2021

Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction

Zero-shot cross-lingual information extraction (IE) describes the constr...

0 Mahsa Yarmohammadi, et al. ∙

∙ 02/10/2021

Differentiable Generative Phonology

The goal of generative phonology, as formulated by Chomsky and Halle (19...

0 Shijie Wu, et al. ∙

∙ 10/06/2020

Do Explicit Alignments Robustly Improve Multilingual Encoders?

Multilingual BERT (mBERT), XLM-RoBERTa (XLMR) and other unsupervised mul...

0 Shijie Wu, et al. ∙

∙ 10/02/2020

Which *BERT? A Survey Organizing Contextualized Encoders

Pretrained contextualized text encoders are now a staple of the NLP comm...

0 Patrick Xia, et al. ∙

∙ 06/20/2020

SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection

A broad goal in natural language processing (NLP) is to develop a system...

0 Ekaterina Vylomova, et al. ∙

∙ 05/20/2020

Applying the Transformer to Character-level Transduction

The transformer has been shown to outperform recurrent neural network-ba...

0 Shijie Wu, et al. ∙

∙ 05/18/2020

Are All Languages Created Equal in Multilingual BERT?

Multilingual BERT (mBERT) trained on 104 languages has shown surprisingl...

0 Shijie Wu, et al. ∙

∙ 05/04/2020

The Paradigm Discovery Problem

This work treats the paradigm discovery problem (PDP), the task of learn...

0 Alexander Erdmann, et al. ∙

∙ 11/04/2019

Emerging Cross-lingual Structure in Pretrained Language Models

We study the problem of multilingual masked language modeling, i.e. the ...

0 Shijie Wu, et al. ∙

∙ 10/25/2019

The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflection

The SIGMORPHON 2019 shared task on cross-lingual transfer and contextual...

0 Arya D. McCarthy, et al. ∙

∙ 06/27/2019

Morphological Irregularity Correlates with Frequency

We present a study of morphological irregularity. Following recent work,...

0 Shijie Wu, et al. ∙

∙ 05/15/2019

Exact Hard Monotonic Attention for Character-Level Transduction

Many common character-level, string-to-string transduction tasks, e.g., ...

0 Shijie Wu, et al. ∙

∙ 04/19/2019

Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT

Pretrained contextual representation models (Peters et al., 2018; Devlin...

0 Shijie Wu, et al. ∙

∙ 04/04/2019

A Simple Joint Model for Improved Contextual Neural Lemmatization

English verbs have multiple forms. For instance, talk may also appear as...

0 Chaitanya Malaviya, et al. ∙

∙ 08/29/2018

Hard Non-Monotonic Attention for Character-Level Transduction

Character-level string-to-string transduction is an important component ...

0 Shijie Wu, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world