research
∙
08/29/2023
Large language models converge toward human-like concept organization
Large language models show human-like performance in knowledge extractio...
share
research
∙
08/17/2023
Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Models
Language models such as mBERT, XLM-R, and BLOOM aim to achieve multiling...
research
∙
06/08/2023
Mapping Brains with Language Models: A Survey
Over the years, many researchers have seemingly made the same observatio...
research
∙
06/02/2023
Large Language Models Converge on Brain-Like Word Representations
One of the greatest puzzles of all time is how understanding arises from...
research
∙
06/01/2023
Being Right for Whose Right Reasons?
Explainability methods are used to benchmark the extent to which model p...
research
∙
05/31/2023
What does the Failure to Reason with "Respectively" in Zero/Few-Shot Settings Tell Us about Language Models?
Humans can effortlessly understand the coordinate structure of sentences...
research
∙
05/25/2023
Private Meeting Summarization Without Performance Loss
Meeting summarization has an enormous business potential, but in additio...
research
∙
05/12/2023
LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development
In this work, we conduct a detailed analysis on the performance of legal...
research
∙
04/20/2023
On the Independence of Association Bias and Empirical Fairness in Language Models
The societal impact of pre-trained language models has prompted research...
research
∙
03/31/2023
WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset
We create WebQAmGaze, a multilingual low-cost eye-tracking-while-reading...
research
∙
02/20/2023
A Two-Sided Discussion of Preregistration of NLP Research
Van Miltenburg et al. (2021) suggest NLP research should adopt preregist...
research
∙
02/13/2023
Implications of the Convergence of Language and Vision Model Geometries
Large-scale pretrained language models (LMs) are said to “lack the abili...
research
∙
12/19/2022
Multi hash embeddings in spaCy
The distributed representation of symbols is one of the key technologies...
research
∙
10/11/2022
Are Pretrained Multilingual Models Equally Fair Across Languages?
Pretrained multilingual language models can help bridge the digital lang...
research
∙
06/20/2022
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold
The prototypical NLP experiment trains a standard architecture on labele...
research
∙
06/09/2022
Ancestor-to-Creole Transfer is Not a Walk in the Park
We aim to learn language models for Creole languages for which large vol...
research
∙
06/01/2022
What a Creole Wants, What a Creole Needs
In recent years, the natural language processing (NLP) community has giv...
research
∙
05/06/2022
QLEVR: A Diagnostic Dataset for Quantificational Language and Elementary Visual Reasoning
Synthetic datasets have successfully been used to probe visual question-...
research
∙
04/22/2022
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks
Logical approaches to representing language have developed and evaluated...
research
∙
03/22/2022
Factual Consistency of Multilingual Pretrained Language Models
Pretrained language models can be queried for factual knowledge, with po...
research
∙
03/21/2022
Word Order Does Matter (And Shuffled Language Models Know It)
Recent studies have shown that language models pretrained and/or fine-tu...
research
∙
03/18/2022
Challenges and Strategies in Cross-Cultural NLP
Various efforts in the Natural Language Processing (NLP) community have ...
research
∙
03/16/2022
Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning
Large multilingual pretrained language models such as mBERT and XLM-RoBE...
research
∙
03/15/2022
Improved Multi-label Classification under Temporal Concept Drift: Rethinking Group-Robust Algorithms in a Label-Wise Setting
In document classification for, e.g., legal and biomedical text, we ofte...
research
∙
03/14/2022
FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing
We present a benchmark suite of four datasets for evaluating the fairnes...
research
∙
03/05/2022
The Impact of Differential Privacy on Group Disparity Mitigation
The performance cost of differential privacy has, for some applications,...
research
∙
02/24/2022
Exploring the Unfairness of DP-SGD Across Settings
End users and regulators require private and fair artificial intelligenc...
research
∙
11/29/2021
Do We Still Need Automatic Speech Recognition for Spoken Language Understanding?
Spoken language understanding (SLU) tasks are usually solved by first tr...
research
∙
11/08/2021
Revisiting Methods for Finding Influential Examples
Several instance-based explainability methods for finding influential tr...
research
∙
10/11/2021
Dynamic Forecasting of Conversation Derailment
Online conversations can sometimes take a turn for the worse, either due...
research
∙
10/08/2021
Evaluation of Summarization Systems across Gender, Age, and Race
Summarization systems are ultimately evaluated by human annotators and r...
research
∙
09/16/2021
Do Language Models Know the Way to Rome?
The global geometry of language models is important for a range of appli...
research
∙
09/13/2021
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color
Pretrained language models have been shown to encode relational informat...
research
∙
09/13/2021
On Language Models for Creoles
Creole languages such as Nigerian Pidgin English and Haitian Creole are ...
research
∙
09/11/2021
The Impact of Positional Encodings on Multilingual Compression
In order to preserve word-order information in a non-autoregressive sett...
research
∙
06/29/2021
On the Interaction of Belief Bias and Explanations
A myriad of explainability methods have been proposed in recent years, b...
research
∙
06/06/2021
Itihasa: A large-scale corpus for Sanskrit to English translation
This work introduces Itihasa, a large-scale translation dataset containi...
research
∙
06/02/2021
John praised Mary because he? Implicit Causality Bias and Its Interaction with Explicit Cues in LMs
Some interpersonal verbs can implicitly attribute causality to either th...
research
∙
06/02/2021
Minimax and Neyman-Pearson Meta-Learning for Outlier Languages
Model-agnostic meta-learning (MAML) has been recently put forth as a str...
research
∙
06/01/2021
Replicating and Extending "Because Their Treebanks Leak": Graph Isomorphism, Covariants, and Parser Performance
Søgaard (2020) obtained results suggesting the fraction of trees occurri...
research
∙
02/17/2021
Do End-to-End Speech Recognition Models Care About Context?
The two most common paradigms for end-to-end speech recognition are conn...
research
∙
01/29/2021
Does injecting linguistic structure into language models lead to better alignment with brain recordings?
Neuroscientists evaluate deep neural networks for natural language proce...
research
∙
01/26/2021
Attention Can Reflect Syntactic Structure (If You Let It)
Since the popularization of the Transformer as a general-purpose feature...
research
∙
10/15/2020
Grammatical Error Correction in Low Error Density Domains: A New Benchmark and Analyses
Evaluation of grammatical error correction (GEC) systems has primarily f...
research
∙
10/12/2020
Joint Semantic Analysis with Document-Level Cross-Task Coherence Rewards
Coreference resolution and semantic role labeling are NLP tasks that cap...
research
∙
09/24/2020
Type B Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias
The one-sided focus on English in previous studies of gender bias in NLP...
research
∙
09/23/2020
Worst-Case-Aware Curriculum Learning for Zero and Few Shot Transfer
Multi-task transfer learning based on pre-trained language encoders achi...
research
∙
05/04/2020
The Sensitivity of Language Models and Humans to Winograd Schema Perturbations
Large-scale pretrained language models are the major driving force behin...
research
∙
05/01/2020
We Need to Talk About Random Splits
Gorman and Bedrick (2019) recently argued for using random splits rather...
research
∙
04/28/2020