A Comprehensive Comparison of Neural Networks as Cognitive Models of Inflection

10/22/2022
by   Adam Wiemerslage, et al.
0

Neural networks have long been at the center of a debate around the cognitive mechanism by which humans process inflectional morphology. This debate has gravitated into NLP by way of the question: Are neural networks a feasible account for human behavior in morphological inflection? We address that question by measuring the correlation between human judgments and neural network probabilities for unknown word inflections. We test a larger range of architectures than previously studied on two important tasks for the cognitive processing debate: English past tense, and German number inflection. We find evidence that the Transformer may be a better account of human behavior than LSTMs on these datasets, and that LSTM features known to increase inflection accuracy do not always result in more human-like behavior.

READ FULL TEXT

page 8

page 13

research
06/04/2019

Are we there yet? Encoder-decoder neural networks as cognitive models of English past tense inflection

The cognitive mechanisms needed to account for the English past tense ha...
research
05/18/2020

Inflecting when there's no majority: Limitations of encoder-decoder neural networks as cognitive models for German plurals

Can artificial neural networks learn to represent inflectional morpholog...
research
10/17/2022

How do we get there? Evaluating transformer neural networks as cognitive models for English past tense inflection

There is an ongoing debate on whether neural networks can grasp the quas...
research
07/20/2021

Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?

Despite being designed for performance rather than cognitive plausibilit...
research
07/12/2018

Recurrent Neural Networks in Linguistic Theory: Revisiting Pinker and Prince (1988) and the Past Tense Debate

Can advances in NLP help advance cognitive modeling? We examine the role...
research
10/02/2018

Predicate learning in neural systems: Discovering latent generative structures

Humans learn complex latent structures from their environments (e.g., na...
research
08/17/2022

Learning Transductions to Test Systematic Compositionality

Recombining known primitive concepts into larger novel combinations is a...

Please sign up or login with your details

Forgot password? Click here to reset