Spin Glass Models of Syntax and Language Evolution

07/31/2015
by   Karthik Siva, et al.
0

Using the SSWL database of syntactic parameters of world languages, and the MIT Media Lab data on language interactions, we construct a spin glass model of language evolution. We treat binary syntactic parameters as spin states, with languages as vertices of a graph, and assigned interaction energies along the edges. We study a rough model of syntax evolution, under the assumption that a strong interaction energy tends to cause parameters to align, as in the case of ferromagnetic materials. We also study how the spin glass model needs to be modified to account for entailment relations between syntactic parameters. This modification leads naturally to a generalization of Potts models with external magnetic field, which consists of a coupling at the vertices of an Ising model and a Potts model with q=3, that have the same edge interactions. We describe the results of simulations of the dynamics of these models, in different temperature and energy regimes. We discuss the linguistic interpretation of the parameters of the physical model.

READ FULL TEXT

page 7

page 8

page 9

page 10

page 15

page 16

page 17

page 18

research
10/02/2016

Syntactic Structures and Code Parameters

We assign binary and ternary error-correcting codes to the data of synta...
research
10/21/2015

Prevalence and recoverability of syntactic parameters in sparse distributed memories

We propose a new method, based on Sparse Distributed Memory (Kanerva Net...
research
04/29/2020

Do Neural Language Models Show Preferences for Syntactic Formalisms?

Recent work on the interpretability of deep neural language models has c...
research
05/29/2023

Syntax and Semantics Meet in the "Middle": Probing the Syntax-Semantics Interface of LMs Through Agentivity

Recent advances in large language models have prompted researchers to ex...
research
09/13/2023

Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs

Most interpretability research in NLP focuses on understanding the behav...
research
02/16/2000

Syntactic Autonomy: Why There is no Autonomy without Symbols and How Self-Organization Might Evolve Them

Two different types of agency are discussed based on dynamically coheren...
research
05/23/2023

An Ising-like model for language evolution

I propose a novel Ising-like model of language evolution. In a simple wa...

Please sign up or login with your details

Forgot password? Click here to reset