research
∙
10/10/2022
Knowledge Prompts: Injecting World Knowledge into Language Models through Soft Prompts
Soft prompts have been recently proposed as a tool for adapting large fr...
share
research
∙
05/25/2022
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation
In this paper, we explore the challenging problem of performing a genera...
research
∙
10/15/2021
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer
As pre-trained language models have gotten larger, there has been growin...
research
∙
09/10/2021
A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations
Language agnostic and semantic-language information isolation is an emer...
research
∙
08/19/2021
Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models
We provide the first exploration of text-to-text transformers (T5) sente...
research
∙
04/15/2021
NT5?! Training T5 to Perform Numerical Reasoning
Numerical reasoning over text (NRoT) presents unique challenges that are...
research
∙
12/28/2020
Universal Sentence Representation Learning with Conditional Masked Language Model
This paper presents a novel training method, Conditional Masked Language...
research
∙
11/07/2020
SeqGenSQL – A Robust Sequence Generation Model for Structured Query Language
We explore using T5 (Raffel et al. (2019)) to directly translate natural...
research
∙
09/29/2020
Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation
Neural models that independently project questions and answers into a sh...
research
∙
07/03/2020
Language-agnostic BERT Sentence Embedding
We adapt multilingual BERT to produce language-agnostic sentence embeddi...
research
∙
05/05/2020
MultiReQA: A Cross-Domain Evaluation for Retrieval Question Answering Models
Retrieval question answering (ReQA) is the task of retrieving a sentence...
research
∙
04/30/2020
Crisscrossed Captions: Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
Image captioning datasets have proven useful for multimodal representati...
research
∙
07/10/2019
ReQA: An Evaluation for End-to-End Answer Retrieval Models
Popular QA benchmarks like SQuAD have driven progress on the task of ide...
research
∙
07/09/2019
Multilingual Universal Sentence Encoder for Semantic Retrieval
We introduce two pre-trained retrieval focused multilingual sentence enc...
research
∙
06/20/2019
Hierarchical Document Encoder for Parallel Corpus Mining
We explore using multilingual document embeddings for nearest neighbor m...
research
∙
02/22/2019
Improving Multilingual Sentence Embedding using Bi-directional Dual Encoder with Additive Margin Softmax
In this paper, we present an approach to learn multilingual sentence emb...
research
∙
10/30/2018
Learning Cross-Lingual Sentence Representations via a Multi-task Dual-Encoder Model
Neural language models have been shown to achieve an impressive level of...
research
∙
07/31/2018
Effective Parallel Corpus Mining using Bilingual Sentence Embeddings
This paper presents an effective approach for parallel corpus mining usi...
research
∙
04/20/2018
Learning Semantic Textual Similarity from Conversations
We present a novel approach to learn representations for sentence-level ...
research
∙
03/29/2018
Universal Sentence Encoder
We present models for encoding sentences into embedding vectors that spe...
research
∙
07/31/2017