Anders Søgaard

research

∙ 08/29/2023

Large language models converge toward human-like concept organization

Large language models show human-like performance in knowledge extractio...

0 Mathias Lykke Gammelgaard, et al. ∙

research

∙ 08/17/2023

Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Models

Language models such as mBERT, XLM-R, and BLOOM aim to achieve multiling...

0 Phillip Rust, et al. ∙

research

∙ 06/08/2023

Mapping Brains with Language Models: A Survey

Over the years, many researchers have seemingly made the same observatio...

0 Antonia Karamolegkou, et al. ∙

research

∙ 06/02/2023

Large Language Models Converge on Brain-Like Word Representations

One of the greatest puzzles of all time is how understanding arises from...

0 Jiaang Li, et al. ∙

research

∙ 06/01/2023

Being Right for Whose Right Reasons?

Explainability methods are used to benchmark the extent to which model p...

0 Terne Sasha Thorn Jakobsen, et al. ∙

research

∙ 05/31/2023

What does the Failure to Reason with "Respectively" in Zero/Few-Shot Settings Tell Us about Language Models?

Humans can effortlessly understand the coordinate structure of sentences...

0 Ruixiang Cui, et al. ∙

research

∙ 05/25/2023

Private Meeting Summarization Without Performance Loss

Meeting summarization has an enormous business potential, but in additio...

0 Seolhwa Lee, et al. ∙

research

∙ 05/12/2023

LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development

In this work, we conduct a detailed analysis on the performance of legal...

0 Ilias Chalkidis, et al. ∙

research

∙ 04/20/2023

On the Independence of Association Bias and Empirical Fairness in Language Models

The societal impact of pre-trained language models has prompted research...

0 Laura Cabello, et al. ∙

research

∙ 03/31/2023

WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset

We create WebQAmGaze, a multilingual low-cost eye-tracking-while-reading...

0 Tiago Ribeiro, et al. ∙

research

∙ 02/20/2023

A Two-Sided Discussion of Preregistration of NLP Research

Van Miltenburg et al. (2021) suggest NLP research should adopt preregist...

0 Anders Søgaard, et al. ∙

research

∙ 02/13/2023

Implications of the Convergence of Language and Vision Model Geometries

Large-scale pretrained language models (LMs) are said to “lack the abili...

0 Jiaang Li, et al. ∙

research

∙ 12/19/2022

Multi hash embeddings in spaCy

The distributed representation of symbols is one of the key technologies...

0 Lester James Miranda, et al. ∙

research

∙ 10/11/2022

Are Pretrained Multilingual Models Equally Fair Across Languages?

Pretrained multilingual language models can help bridge the digital lang...

0 Laura Cabello Piqueras, et al. ∙

research

∙ 06/20/2022

Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold

The prototypical NLP experiment trains a standard architecture on labele...

0 Sebastian Ruder, et al. ∙

research

∙ 06/09/2022

Ancestor-to-Creole Transfer is Not a Walk in the Park

We aim to learn language models for Creole languages for which large vol...

3 Heather Lent, et al. ∙

research

∙ 06/01/2022

What a Creole Wants, What a Creole Needs

In recent years, the natural language processing (NLP) community has giv...

0 Heather Lent, et al. ∙

research

∙ 05/06/2022

QLEVR: A Diagnostic Dataset for Quantificational Language and Elementary Visual Reasoning

Synthetic datasets have successfully been used to probe visual question-...

12 Zechen Li, et al. ∙

research

∙ 04/22/2022

Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks

Logical approaches to representing language have developed and evaluated...

0 Ruixiang Cui, et al. ∙

research

∙ 03/22/2022

Factual Consistency of Multilingual Pretrained Language Models

Pretrained language models can be queried for factual knowledge, with po...

2 Constanza Fierro, et al. ∙

research

∙ 03/21/2022

Word Order Does Matter (And Shuffled Language Models Know It)

Recent studies have shown that language models pretrained and/or fine-tu...

0 Vinit Ravishankar, et al. ∙

research

∙ 03/18/2022

Challenges and Strategies in Cross-Cultural NLP

Various efforts in the Natural Language Processing (NLP) community have ...

12 Daniel Hershcovich, et al. ∙

research

∙ 03/16/2022

Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning

Large multilingual pretrained language models such as mBERT and XLM-RoBE...

0 Miryam de Lhoneux, et al. ∙

research

∙ 03/15/2022

Improved Multi-label Classification under Temporal Concept Drift: Rethinking Group-Robust Algorithms in a Label-Wise Setting

In document classification for, e.g., legal and biomedical text, we ofte...

0 Ilias Chalkidis, et al. ∙

research

∙ 03/14/2022

FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing

We present a benchmark suite of four datasets for evaluating the fairnes...

0 Ilias Chalkidis, et al. ∙

research

∙ 03/05/2022

The Impact of Differential Privacy on Group Disparity Mitigation

The performance cost of differential privacy has, for some applications,...

0 Victor Petrén Bach Hansen, et al. ∙

research

∙ 02/24/2022

Exploring the Unfairness of DP-SGD Across Settings

End users and regulators require private and fair artificial intelligenc...

0 Frederik Noe, et al. ∙

research

∙ 11/29/2021

Do We Still Need Automatic Speech Recognition for Spoken Language Understanding?

Spoken language understanding (SLU) tasks are usually solved by first tr...

0 Lasse Borgholt, et al. ∙

research

∙ 11/08/2021

Revisiting Methods for Finding Influential Examples

Several instance-based explainability methods for finding influential tr...

0 Karthikeyan K, et al. ∙

research

∙ 10/11/2021

Dynamic Forecasting of Conversation Derailment

Online conversations can sometimes take a turn for the worse, either due...

0 Yova Kementchedjhieva, et al. ∙

research

∙ 10/08/2021

Evaluation of Summarization Systems across Gender, Age, and Race

Summarization systems are ultimately evaluated by human annotators and r...

0 Anna Jørgensen, et al. ∙

research

∙ 09/16/2021

Do Language Models Know the Way to Rome?

The global geometry of language models is important for a range of appli...

0 Bastien Liétard, et al. ∙

research

∙ 09/13/2021

Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color

Pretrained language models have been shown to encode relational informat...

0 Mostafa Abdou, et al. ∙

research

∙ 09/13/2021

On Language Models for Creoles

Creole languages such as Nigerian Pidgin English and Haitian Creole are ...

23 Heather Lent, et al. ∙

research

∙ 09/11/2021

The Impact of Positional Encodings on Multilingual Compression

In order to preserve word-order information in a non-autoregressive sett...

0 Vinit Ravishankar, et al. ∙

research

∙ 06/29/2021

On the Interaction of Belief Bias and Explanations

A myriad of explainability methods have been proposed in recent years, b...

1 Ana Valeria Gonzalez, et al. ∙

research

∙ 06/06/2021

Itihasa: A large-scale corpus for Sanskrit to English translation

This work introduces Itihasa, a large-scale translation dataset containi...

1 Rahul Aralikatte, et al. ∙

research

∙ 06/02/2021

John praised Mary because he? Implicit Causality Bias and Its Interaction with Explicit Cues in LMs

Some interpersonal verbs can implicitly attribute causality to either th...

0 Yova Kementchedjhieva, et al. ∙

research

∙ 06/02/2021

Minimax and Neyman-Pearson Meta-Learning for Outlier Languages

Model-agnostic meta-learning (MAML) has been recently put forth as a str...

0 Edoardo Maria Ponti, et al. ∙

research

∙ 06/01/2021

Replicating and Extending "Because Their Treebanks Leak": Graph Isomorphism, Covariants, and Parser Performance

Søgaard (2020) obtained results suggesting the fraction of trees occurri...

0 Mark Anderson, et al. ∙

research

∙ 02/17/2021

Do End-to-End Speech Recognition Models Care About Context?

The two most common paradigms for end-to-end speech recognition are conn...

0 Lasse Borgholt, et al. ∙

research

∙ 01/29/2021

Does injecting linguistic structure into language models lead to better alignment with brain recordings?

Neuroscientists evaluate deep neural networks for natural language proce...

24 Mostafa Abdou, et al. ∙

research

∙ 01/26/2021

Attention Can Reflect Syntactic Structure (If You Let It)

Since the popularization of the Transformer as a general-purpose feature...

13 Vinit Ravishankar, et al. ∙

research

∙ 10/15/2020

Grammatical Error Correction in Low Error Density Domains: A New Benchmark and Analyses

Evaluation of grammatical error correction (GEC) systems has primarily f...

0 Simon Flachs, et al. ∙

research

∙ 10/12/2020

Joint Semantic Analysis with Document-Level Cross-Task Coherence Rewards

Coreference resolution and semantic role labeling are NLP tasks that cap...

0 Rahul Aralikatte, et al. ∙

research

∙ 09/24/2020

Type B Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias

The one-sided focus on English in previous studies of gender bias in NLP...

0 Ana Valeria Gonzalez, et al. ∙

research

∙ 09/23/2020

Worst-Case-Aware Curriculum Learning for Zero and Few Shot Transfer

Multi-task transfer learning based on pre-trained language encoders achi...

0 Sheng Zhang, et al. ∙

research

∙ 05/04/2020

The Sensitivity of Language Models and Humans to Winograd Schema Perturbations

Large-scale pretrained language models are the major driving force behin...

0 Mostafa Abdou, et al. ∙

research

∙ 05/01/2020

We Need to Talk About Random Splits

Gorman and Bedrick (2019) recently argued for using random splits rather...

0 Anders Søgaard, et al. ∙

research

∙ 04/28/2020

Weakly Supervised POS Taggers Perform Poorly on Truly Low-Resource Languages

Part-of-speech (POS) taggers for low-resource languages which are exclus...

0 Katharina Kann, et al. ∙

Anders Søgaard

Featured Co-authors