The advent and fall of a vocabulary learning bias from communicative efficiency

05/24/2021
by   David Carrera-Casado, et al.
9

It is well-known that, when sufficiently young children encounter a new word, they tend to attach it to a meaning that does not have a word yet in their lexicon. In previous research, the strategy was shown to be optimal from an information theoretic standpoint. However, the information theoretic model employed neither explains the weakening of that vocabulary learning bias in older children or polylinguals nor reproduces Zipf's meaning-frequency law, namely the non-linear relationship between the number of meanings of a word and its frequency. Here we consider a generalization of the model that is channeled to reproduce that law. The analysis of the new model reveals regions of the phase space where the bias disappears consistently with the weakening or loss of the bias in older children or polylinguals. In the deep learning era, the model is a transparent low-dimensional tool for future experimental research and illustrates the predictive power of a theoretical framework originally designed to shed light on the origins of Zipf's rank-frequency law.

READ FULL TEXT

page 16

page 18

page 19

page 22

page 23

page 25

page 27

research
12/08/2014

Optimization models of natural communication

A family of information theoretic models of communication was introduced...
research
12/30/2017

The origins of Zipf's meaning-frequency law

In his pioneering research, G. K. Zipf observed that more frequent words...
research
11/30/2018

Modeling natural language emergence with integral transform theory and reinforcement learning

Zipf's law predicts a power-law relationship between word rank and frequ...
research
11/27/2016

The polysemy of the words that children learn over time

Here we study polysemy as a potential learning bias in vocabulary learni...
research
10/20/2017

Is space a word, too?

For words, rank-frequency distributions have long been heralded for adhe...
research
09/13/2021

The Emergence of the Shape Bias Results from Communicative Efficiency

By the age of two, children tend to assume that new word categories are ...
research
07/07/2022

Predicting Word Learning in Children from the Performance of Computer Vision Systems

For human children as well as machine learning systems, a key challenge ...

Please sign up or login with your details

Forgot password? Click here to reset