research
∙
08/31/2023
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
We present Belebele, a multiple-choice machine reading comprehension (MR...
share
research
∙
05/26/2023
A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models
Distillation from Weak Teacher (DWT) is a method of transferring knowled...
research
∙
01/25/2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
Large multilingual language models typically rely on a single vocabulary...
research
∙
10/14/2022
Adaptable Claim Rewriting with Offline Reinforcement Learning for Effective Misinformation Discovery
We propose a novel system to help fact-checkers formulate search queries...
research
∙
10/12/2021
Attention-guided Generative Models for Extractive Question Answering
We propose a novel method for applying Transformer models to extractive ...
research
∙
09/27/2021
Multiplicative Position-aware Transformer Models for Language Understanding
Transformer models, which leverage architectural improvements like self-...
research
∙
11/26/2020
Decoding and Diversity in Machine Translation
Neural Machine Translation (NMT) systems are typically evaluated using a...
research
∙
09/28/2020
Improve Transformer Models with Better Relative Position Embeddings
Transformer architectures rely on explicit position encodings in order t...
research
∙
09/22/2020
Embedding-based Zero-shot Retrieval through Query Generation
Passage retrieval addresses the problem of locating relevant passages, u...
research
∙
03/16/2020
TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding
Bidirectional Encoder Representations from Transformers (BERT) has recen...
research
∙
10/31/2019
Pseudolikelihood Reranking with Masked Language Models
We rerank with scores from pretrained masked language models like BERT t...
research
∙
07/17/2018
Learning Noise-Invariant Representations for Robust Speech Recognition
Despite rapid advances in speech recognition, current models remain brit...
research
∙
09/16/2017