research
∙
07/06/2023
Generalizing Backpropagation for Gradient-Based Interpretability
Many popular feature-attribution methods for interpreting deep neural ne...
share
research
∙
05/24/2023
Deriving Language Models from Masked Language Models
Masked language models (MLM) do not explicitly define a distribution ove...
research
∙
03/02/2023
Learning to Grow Pretrained Models for Efficient Transformer Training
Scaling transformers has led to significant breakthroughs in many domain...
research
∙
12/20/2022
A Measure-Theoretic Characterization of Tight Language Models
Language modeling, a central task in natural language processing, involv...
research
∙
10/08/2022
An Ordinal Latent Variable Model of Conflict Intensity
For the quantitative monitoring of international relations, political ev...
research
∙
05/07/2022
UniMorph 4.0: Universal Morphology
The Universal Morphology (UniMorph) project is a collaborative effort pr...
research
∙
05/04/2022
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models
The success of multilingual pre-trained models is underpinned by their a...
research
∙
01/20/2022
A Latent-Variable Model for Intrinsic Probing
The success of pre-trained contextualized representations has prompted r...
research
∙
10/15/2021
Probing as Quantifying the Inductive Bias of Pre-trained Representations
Pre-trained contextual representations have led to dramatic performance ...
research
∙
09/27/2021
Classifying Dyads for Militarized Conflict Analysis
Understanding the origins of militarized conflict is a complex, yet impo...
research
∙
10/06/2020
Intrinsic Probing through Dimension Selection
Most modern NLP systems make use of pre-trained contextual representatio...
research
∙
06/20/2020