research
∙
08/23/2023
Curriculum Learning with Adam: The Devil Is in the Wrong Details
Curriculum learning (CL) posits that machine learning models – similar t...
share
research
∙
06/21/2023
Feature Interactions Reveal Linguistic Structure in Language Models
We study feature interactions in the context of feature attribution meth...
research
∙
07/21/2022
The Birth of Bias: A case study on the evolution of gender bias in an English language model
Detecting and mitigating harmful biases in modern language models are wi...
research
∙
09/30/2021
Syntactic Persistence in Language Models: Priming as a Window into Abstract Language Representations
We investigate the extent to which modern, neural language models are su...
research
∙
05/28/2021
Language Models Use Monotonicity to Assess NPI Licensing
We investigate the semantic knowledge of language models (LMs), focusing...
research
∙
04/26/2021
Attention vs non-attention for a Shapley-based explanation method
The field of explainable AI has recently seen an explosion in the number...
research
∙
01/27/2021
Language Modelling as a Multi-Task Problem
In this paper, we propose to study language modelling as a multi-task pr...
research
∙
11/13/2020
diagNNose: A Library for Neural Activation Analysis
In this paper we introduce diagNNose, an open source library for analysi...
research
∙
09/19/2019
Analysing Neural Language Models: Contextual Decomposition Reveals Default Reasoning in Number and Gender Assignment
Extensive research has recently shown that recurrent neural language mod...
research
∙
08/31/2018