research
∙
05/17/2023
Token-wise Decomposition of Autoregressive Language Model Hidden States for Analyzing Model Predictions
While there is much recent interest in studying why Transformer-based la...
share
research
∙
04/22/2023
Transformer-Based LM Surprisal Predicts Human Reading Times Best with About Two Billion Training Tokens
Recent psycholinguistic studies have drawn conflicting conclusions about...
research
∙
12/23/2022
Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?
This work presents a detailed linguistic analysis into why larger Transf...
research
∙
12/21/2022
Entropy- and Distance-Based Predictors From GPT-2 Attention Patterns Predict Reading Times Over and Above GPT-2 Surprisal
Transformer-based large language models are trained to make predictions ...
research
∙
09/25/2022
A Deep Learning Approach to Analyzing Continuous-Time Systems
Scientists often use observational time series data to study complex nat...
research
∙
06/20/2020
The Importance of Category Labels in Grammar Induction with Child-directed Utterances
Recent progress in grammar induction has shown that grammar induction is...
research
∙
09/10/2018
Depth-bounding is effective: Improvements and evaluation of unsupervised PCFG induction
There have been several recent attempts to improve the accuracy of gramm...
research
∙
02/23/2018