Emergence of order in random languages

02/20/2019
by   E. DeGiuli, et al.
0

We consider languages generated by weighted context-free grammars. It is shown that the behaviour of large texts is controlled by saddle-point equations for an appropriate generating function. We then consider ensembles of grammars, in particular the Random Language Model of E. DeGiuli, Phys. Rev. Lett., 2019. This model is solved in the replica-symmetric ansatz, which is valid in the high-temperature, disordered phase. It is shown that in the phase in which languages carry information, the replica symmetry must be broken.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2018

Random Language Model: a path to principled complexity

Many complex generative systems use languages to create structured objec...
research
07/01/2022

The closest vector problem and the zero-temperature p-spin landscape for lossy compression

We consider a high-dimensional random constrained optimization problem i...
research
05/06/2021

The replica-symmetric free energy for Ising spin glasses with orthogonally invariant couplings

We study the mean-field Ising spin glass model with external field, wher...
research
03/10/2020

On the coexistence of competing languages

We investigate the evolution of competing languages, a subject where muc...
research
06/09/2022

Ancestor-to-Creole Transfer is Not a Walk in the Park

We aim to learn language models for Creole languages for which large vol...
research
09/06/2023

Strictly Locally Testable and Resources Restricted Control Languages in Tree-Controlled Grammars

Tree-controlled grammars are context-free grammars where the derivation ...
research
08/12/2022

The planted XY model: thermodynamics and inference

In this paper we study a fully connected planted spin glass named the pl...

Please sign up or login with your details

Forgot password? Click here to reset