Naomi Saphra | DeepAI

DeepAI AI Chat

Featured Co-authors

Graham Neubig
243 publications
Kyunghyun Cho
218 publications
Ryan Cotterell
156 publications
Yoav Goldberg
120 publications
Trevor Cohn
79 publications
Chris Dyer
79 publications
Antonios Anastasopoulos
66 publications
Lingpeng Kong
59 publications
Jacob Eisenstein
54 publications
Tal Linzen
52 publications
Kevin Duh
48 publications

∙ 09/13/2023

Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs

Most interpretability research in NLP focuses on understanding the behav...

0 Angelica Chen, et al. ∙

∙ 08/18/2023

Latent State Models of Training Dynamics

The impact of randomness on model training is poorly understood. How do ...

0 Michael Y. Hu, et al. ∙

∙ 05/24/2023

Dynamic Masking Rate Schedules for MLM Pretraining

Most works on transformers trained with the Masked Language Modeling (ML...

0 Zachary Ankner, et al. ∙

∙ 11/17/2022

One Venue, Two Conferences: The Separation of Chinese and American Citation Networks

At NeurIPS, American and Chinese institutions cite papers from each othe...

0 Bingchen Zhao, et al. ∙

∙ 08/17/2022

Learning Transductions to Test Systematic Compositionality

Recombining known primitive concepts into larger novel combinations is a...

0 Josef Valvoda, et al. ∙

∙ 05/24/2022

Linear Connectivity Reveals Generalization Strategies

It is widely accepted in the mode connectivity literature that when two ...

3 Jeevesh Juneja, et al. ∙

∙ 06/30/2021

The MultiBERTs: BERT Reproductions for Robustness Analysis

Experiments with pretrained models such as BERT are often based on a sin...

0 Thibault Sellam, et al. ∙

∙ 05/21/2021

A Non-Linear Structural Probe

Probes are models devised to investigate the encoding of knowledge – e.g...

0 Jennifer C. White, et al. ∙

∙ 10/06/2020

LSTMs Compose (and Learn) Bottom-Up

Recent work in NLP shows that LSTM language models capture hierarchical ...

0 Naomi Saphra, et al. ∙

∙ 10/05/2020

Pareto Probing: Trading Off Accuracy for Complexity

The question of how to probe contextual word representations in a way th...

0 Tiago Pimentel, et al. ∙

∙ 04/27/2020

Word Interdependence Exposes How LSTMs Compose Representations

Recent work in NLP shows that LSTM language models capture compositional...

0 Naomi Saphra, et al. ∙

∙ 11/12/2019

How to Evaluate Word Representations of Informal Domain?

Diverse word representations have surged in most state-of-the-art natura...

0 Yekun Chai, et al. ∙

∙ 07/22/2019

Sparsity Emerges Naturally in Neural Language Models

Concerns about interpretability, computational resources, and principled...

0 Naomi Saphra, et al. ∙

∙ 11/01/2018

Understanding Learning Dynamics Of Language Models with SVCCA

Recent work has demonstrated that neural language models encode linguist...

0 Naomi Saphra, et al. ∙

∙ 01/15/2017

DyNet: The Dynamic Neural Network Toolkit

We describe DyNet, a toolkit for implementing neural network models base...

0 Graham Neubig, et al. ∙

∙ 06/27/2016

Evaluating Informal-Domain Word Representations With UrbanDictionary

Existing corpora for intrinsic evaluation are not targeted towards tasks...

0 Naomi Saphra, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world