Jingfei Du | DeepAI

DeepAI AI Chat

Featured Co-authors

William Yang Wang
166 publications
Yu Chen
160 publications
Luke Zettlemoyer
160 publications
Sebastian Riedel
105 publications
Douwe Kiela
70 publications
Michael Auli
68 publications
Mike Lewis
64 publications
Omer Levy
63 publications
Wen-tau Yih
61 publications
Wei-Ning Hsu
59 publications
Xian Li
56 publications

∙ 05/23/2023

Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality

Contrastively trained vision-language models have achieved remarkable pr...

0 Harman Singh, et al. ∙

∙ 11/11/2022

Speech-to-Speech Translation For A Real-world Unwritten Language

We study speech-to-speech translation (S2ST) that translates speech from...

0 Peng-Jen Chen, et al. ∙

∙ 11/08/2022

SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations

We present SpeechMatrix, a large-scale multilingual corpus of speech-to-...

0 Paul-Ambroise Duquenne, et al. ∙

∙ 05/30/2022

Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models

Pre-trained masked language models successfully perform few-shot learnin...

0 Mengzhou Xia, et al. ∙

∙ 05/24/2022

On the Role of Bidirectionality in Language Model Pre-Training

Prior work on language model pre-training has explored different archite...

0 Mikel Artetxe, et al. ∙

∙ 05/03/2022

Improving In-Context Few-Shot Learning via Self-Supervised Training

Self-supervised pretraining has made few-shot learning possible for many...

1 Mingda Chen, et al. ∙

∙ 12/20/2021

Efficient Large Scale Language Modeling with Mixtures of Experts

Mixture of Experts layers (MoEs) enable efficient scaling of language mo...

10 Mikel Artetxe, et al. ∙

∙ 12/20/2021

Few-shot Learning with Multilingual Language Models

Large-scale autoregressive language models such as GPT-3 are few-shot le...

8 Xi Victoria Lin, et al. ∙

∙ 05/02/2021

Larger-Scale Transformers for Multilingual Masked Language Modeling

Recent work has demonstrated the effectiveness of cross-lingual language...

0 Naman Goyal, et al. ∙

∙ 11/03/2020

Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

State-of-the-art natural language understanding classification models fo...

16 Beliz Gunel, et al. ∙

∙ 10/05/2020

Self-training Improves Pre-training for Natural Language Understanding

Unsupervised pre-training has led to much recent progress in natural lan...

0 Jingfei Du, et al. ∙

∙ 09/27/2020

Answering Complex Open-Domain Questions with Multi-Hop Dense Retrieval

We propose a simple and efficient multi-hop dense retrieval approach for...

0 Wenhan Xiong, et al. ∙

∙ 04/29/2020

General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference

The state of the art on many NLP tasks is currently achieved by large pr...

0 Jingfei Du, et al. ∙

∙ 12/20/2019

Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model

Recent breakthroughs of pretrained language models have shown the effect...

0 Wenhan Xiong, et al. ∙

∙ 07/26/2019

RoBERTa: A Robustly Optimized BERT Pretraining Approach

Language model pretraining has led to significant performance gains but ...

0 Yinhan Liu, et al. ∙

∙ 04/09/2019

Knowledge-Augmented Language Model and its Application to Unsupervised Named-Entity Recognition

Traditional language models are unable to efficiently model entity names...

0 Angli Liu, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world