The cognitive roots of regularization in language

03/09/2017
by   Vanessa Ferdinand, et al.
0

Regularization occurs when the output a learner produces is less variable than the linguistic data they observed. In an artificial language learning experiment, we show that there exist at least two independent sources of regularization bias in cognition: a domain-general source based on cognitive load and a domain-specific source triggered by linguistic stimuli. Both of these factors modulate how frequency information is encoded and produced, but only the production-side modulations result in regularization (i.e. cause learners to eliminate variation from the observed input). We formalize the definition of regularization as the reduction of entropy and find that entropy measures are better at identifying regularization behavior than frequency-based analyses. We also use a model of cultural transmission to extrapolate from our experimental data in order to predict the amount of regularization which would develop in each experimental condition if the artificial language was transmitted over several generations of learners. Here we find an interaction between cognitive load and linguistic domain, suggesting that the effect of cognitive constraints can become more complex when put into the context of cultural evolution: although learning biases certainly carry information about the course of language evolution, we should not expect a one-to-one correspondence between the micro-level processes that regularize linguistic datasets and the macro-level evolution of linguistic regularity.

READ FULL TEXT
research
08/17/2022

What Artificial Neural Networks Can Tell Us About Human Language Acquisition

Rapid progress in machine learning for natural language processing has t...
research
01/10/2020

Co-evolution of language and agents in referential games

Referential games offer a grounded learning environment for neural agent...
research
03/01/2022

Learning Robust Real-Time Cultural Transmission without Human Data

Cultural transmission is the domain-general social skill that allows age...
research
02/09/2019

Network connectivity dynamics affect the evolution of culturally transmitted variants

The distribution of cultural variants in a population is shaped by both ...
research
03/07/2021

TypeShift: A User Interface for Visualizing the Typing Production Process

TypeShift is a tool for visualizing linguistic patterns in the timing of...
research
09/10/2023

Large Language Models for Difficulty Estimation of Foreign Language Content with Application to Language Learning

We use large language models to aid learners enhance proficiency in a fo...
research
07/04/2022

Domain-Independent Deception: Definition, Taxonomy and the Linguistic Cues Debate

Internet-based economies and societies are drowning in deceptive attacks...

Please sign up or login with your details

Forgot password? Click here to reset