research
∙
05/18/2023
mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences
We present our work on developing a multilingual, efficient text-to-text...
share
research
∙
05/09/2023
WikiWeb2M: A Page-Level Multimodal Wikipedia Dataset
Webpages have been a rich resource for language and vision-language task...
research
∙
05/05/2023
A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding
Webpages have been a rich, scalable resource for vision-language and lan...
research
∙
03/23/2023
CoBIT: A Contrastive Bi-directional Image-Text Generation Model
The field of vision and language has witnessed a proliferation of pre-tr...
research
∙
03/17/2023
CoLT5: Faster Long-Range Transformers with Conditional Computation
Many natural language processing tasks benefit from long inputs, but pro...
research
∙
12/15/2021
LongT5: Efficient Text-To-Text Transformer for Long Sequences
Recent work has shown that either (1) increasing the input length or (2)...
research
∙
09/10/2021
MURAL: Multimodal, Multitask Retrieval Across Languages
Both image-caption pairs and translation pairs provide the means to lear...
research
∙
07/30/2021
Towards Universality in Multilingual Text Rewriting
In this work, we take the first steps towards building a universal rewri...
research
∙
10/08/2020
TextSETTR: Label-Free Text Style Extraction and Tunable Targeted Restyling
We present a novel approach to the problem of text style transfer. Unlik...
research
∙
09/29/2020
Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation
Neural models that independently project questions and answers into a sh...
research
∙
05/05/2020
MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models
Retrieval question answering (ReQA) is the task of retrieving a sentence...
research
∙
08/27/2019
Bridging the Gap for Tokenizer-Free Language Models
Purely character-based language models (LMs) have been lagging in qualit...
research
∙
07/09/2019
Multilingual Universal Sentence Encoder for Semantic Retrieval
We introduce two pre-trained retrieval focused multilingual sentence enc...
research
∙
06/20/2019
Hierarchical Document Encoder for Parallel Corpus Mining
We explore using multilingual document embeddings for nearest neighbor m...
research
∙
02/22/2019
Improving Multilingual Sentence Embedding using Bi-directional Dual Encoder with Additive Margin Softmax
In this paper, we present an approach to learn multilingual sentence emb...
research
∙
08/09/2018
Character-Level Language Modeling with Deeper Self-Attention
LSTMs and other RNN variants have shown strong performance on character-...
research
∙
07/31/2018