Noah Constant | DeepAI

AI Chat

Featured Co-authors

Graham Neubig
243 publications
Yi Tay
76 publications
Pengfei Liu
75 publications
Mohammad Norouzi
71 publications
Sebastian Ruder
68 publications
Orhan Firat
68 publications
Junjie Hu
59 publications
Mohit Iyyer
57 publications
Chris Callison-Burch
57 publications
Colin Raffel
57 publications
Yinfei Yang
42 publications

∙ 04/18/2023

UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining

Pretrained multilingual large language models have typically used heuris...

0 Hyung Won Chung, et al. ∙

∙ 12/20/2022

Character-Aware Models Improve Visual Text Rendering

Current image generation models struggle to reliably produce well-formed...

0 Rosanne Liu, et al. ∙

∙ 10/01/2022

FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation

We present FRMT, a new dataset and evaluation benchmark for Few-shot Reg...

0 Parker Riley, et al. ∙

∙ 09/29/2022

Bidirectional Language Models Are Also Few-shot Learners

Large language models such as GPT-3 (Brown et al., 2020) can perform arb...

3 Ajay Patel, et al. ∙

∙ 08/10/2022

Reducing Retraining by Recycling Parameter-Efficient Prompts

Parameter-efficient methods are able to use a single frozen pre-trained ...

0 Brian Lester, et al. ∙

∙ 05/25/2022

Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation

In this paper, we explore the challenging problem of performing a genera...

6 Tu Vu, et al. ∙

∙ 10/15/2021

SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer

As pre-trained language models have gotten larger, there has been growin...

5 Tu Vu, et al. ∙

∙ 08/19/2021

Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models

We provide the first exploration of text-to-text transformers (T5) sente...

4 Jianmo Ni, et al. ∙

∙ 07/30/2021

Towards Universality in Multilingual Text Rewriting

In this work, we take the first steps towards building a universal rewri...

0 Xavier Garcia, et al. ∙

∙ 06/03/2021

nmT5 – Is parallel data still relevant for pre-training massively multilingual language models?

Recently, mT5 - a massively multilingual version of T5 - leveraged a uni...

0 Mihir Kale, et al. ∙

∙ 05/28/2021

ByT5: Towards a token-free future with pre-trained byte-to-byte models

Most widely-used pre-trained language models operate on sequences of tok...

0 Linting Xue, et al. ∙

∙ 04/18/2021

The Power of Scale for Parameter-Efficient Prompt Tuning

In this work, we explore "prompt tuning", a simple yet effective mechani...

0 Brian Lester, et al. ∙

∙ 04/15/2021

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation

Machine learning has brought striking advances in multilingual natural l...

0 Sebastian Ruder, et al. ∙

∙ 03/11/2021

Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution

We propose a straightforward vocabulary adaptation scheme to extend the ...

0 Xavier Garcia, et al. ∙

∙ 10/22/2020

Multilingual Synthetic Question and Answer Generation for Cross-Lingual Reading Comprehension

We propose a simple method to generate large amounts of multilingual que...

0 Siamak Shakeri, et al. ∙

∙ 10/22/2020

mT5: A massively multilingual pre-trained text-to-text transformer

The recent "Text-to-Text Transfer Transformer" (T5) leveraged a unified ...

0 Linting Xue, et al. ∙

∙ 10/08/2020

TextSETTR: Label-Free Text Style Extraction and Tunable Targeted Restyling

We present a novel approach to the problem of text style transfer. Unlik...

0 Parker Riley, et al. ∙

∙ 05/05/2020

MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models

Retrieval question answering (ReQA) is the task of retrieving a sentence...

0 Mandy Guo, et al. ∙

∙ 04/11/2020

LAReQA: Language-agnostic answer retrieval from a multilingual pool

We present LAReQA, a challenging new benchmark for language-agnostic ans...

0 Uma Roy, et al. ∙

∙ 08/27/2019

Bridging the Gap for Tokenizer-Free Language Models

Purely character-based language models (LMs) have been lagging in qualit...

0 Dokook Choe, et al. ∙

∙ 07/10/2019

ReQA: An Evaluation for End-to-End Answer Retrieval Models

Popular QA benchmarks like SQuAD have driven progress on the task of ide...

0 Amin Ahmad, et al. ∙

∙ 07/09/2019

Multilingual Universal Sentence Encoder for Semantic Retrieval

We introduce two pre-trained retrieval focused multilingual sentence enc...

0 Yinfei Yang, et al. ∙

∙ 08/09/2018

Character-Level Language Modeling with Deeper Self-Attention

LSTMs and other RNN variants have shown strong performance on character-...

0 Rami Al-Rfou, et al. ∙

∙ 04/20/2018

Learning Semantic Textual Similarity from Conversations

We present a novel approach to learn representations for sentence-level ...

0 Yinfei Yang, et al. ∙

∙ 03/29/2018

Universal Sentence Encoder

We present models for encoding sentences into embedding vectors that spe...

0 Daniel Cer, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world