Critical behavior in a cross-situational lexicon learning scenario

06/13/2012
by   P. F. C. Tilles, et al.
0

The associationist account for early word-learning is based on the co-occurrence between objects and words. Here we examine the performance of a simple associative learning algorithm for acquiring the referents of words in a cross-situational scenario affected by noise produced by out-of-context words. We find a critical value of the noise parameter γ_c above which learning is impossible. We use finite-size scaling to show that the sharpness of the transition persists across a region of order τ^-1/2 about γ_c, where τ is the number of learning trials, as well as to obtain the learning error (scaling function) in the critical region. In addition, we show that the distribution of durations of periods when the learning error is zero is a power law with exponent -3/2 at the critical point.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/26/2017

Phase Transitions in Image Denoising via Sparsely Coding Convolutional Neural Networks

Neural networks are analogous in many ways to spin glasses, systems whic...
research
05/24/2020

An inequality for the number of periods in a word

We prove an inequality for the number of periods in a word x in terms of...
research
02/01/2019

Critical exponent of infinite balanced words via the Pell number system

In a recent paper of Rampersad et al., the authors conjectured that the ...
research
03/10/2016

Zipf's law emerges asymptotically during phase transitions in communicative systems

Zipf's law predicts a power-law relationship between word rank and frequ...
research
11/15/2022

Power-law Scaling to Assist with Key Challenges in Artificial Intelligence

Power-law scaling, a central concept in critical phenomena, is found to ...
research
06/15/2021

Warning Signs for Non-Markovian Bifurcations: Color Blindness and Scaling Laws

Warning signs for tipping points (or critical transitions) have been ver...
research
10/01/2020

Emergence of a finite-size-scaling function in the supervised learning of the Ising phase transition

We investigate the connection between the supervised learning of the bin...

Please sign up or login with your details

Forgot password? Click here to reset