research
∙
06/16/2023
Politeness Stereotypes and Attack Vectors: Gender Stereotypes in Japanese and Korean Language Models
In efforts to keep up with the rapid progress and use of large language ...
share
research
∙
05/22/2023
Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs
Colexification in comparative linguistics refers to the phenomenon of a ...
research
∙
03/08/2023
MenuCraft: Interactive Menu System Design with Large Language Models
Menu system design is a challenging task involving many design options a...
research
∙
07/28/2022
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions
Large amounts of training data are one of the major reasons for the high...
research
∙
04/16/2021
Enriching a Model's Notion of Belief using a Persistent Memory
Although pretrained language models (PTLMs) have been shown to contain s...
research
∙
02/22/2021
Position Information in Transformers: An Overview
Transformers are arguably the main workhorse in recent Natural Language ...
research
∙
01/02/2021
Superbizarre Is Not Superb: Improving BERT's Interpretations of Complex Words with Derivational Morphology
How does the input segmentation of pretrained language models (PLMs) aff...
research
∙
09/15/2020
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners
When scaled to hundreds of billions of parameters, pretrained language m...
research
∙
06/16/2020
Modeling Graph Structure via Relative Position for Better Text Generation from Knowledge Graphs
We present a novel encoder-decoder architecture for graph-to-text genera...
research
∙
05/02/2020
BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA
Khandelwal et al. (2020) show that a k-nearest-neighbor (kNN) component ...
research
∙
04/18/2020
SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings
Word alignments are useful for tasks like statistical and neural machine...
research
∙
12/12/2019
Extending Machine Language Models toward Human-Level Language Understanding
Language is central to human intelligence. We review recent breakthrough...
research
∙
11/09/2019
BERT is Not a Knowledge Base (Yet): Factual Knowledge vs. Name-Based Reasoning in Unsupervised QA
The BERT language model (LM) (Devlin et al., 2019) is surprisingly good ...
research
∙
11/08/2019
Negated LAMA: Birds cannot fly
Pretrained language models have achieved remarkable improvements in a br...
research
∙
07/30/2018
