A Cross-Linguistic Pressure for Uniform Information Density in Word Order

06/06/2023
by   Thomas Hikaru Clark, et al.
7

While natural languages differ widely in both canonical word order and word order flexibility, their word orders still follow shared cross-linguistic statistical patterns, often attributed to functional pressures. In the effort to identify these pressures, prior work has compared real and counterfactual word orders. Yet one functional pressure has been overlooked in such investigations: the uniform information density (UID) hypothesis, which holds that information should be spread evenly throughout an utterance. Here, we ask whether a pressure for UID may have influenced word order patterns cross-linguistically. To this end, we use computational models to test whether real orders lead to greater information uniformity than counterfactual orders. In our empirical study of 10 typologically diverse languages, we find that: (i) among SVO languages, real word orders consistently have greater uniformity than reverse word orders, and (ii) only linguistically implausible counterfactual orders consistently exceed the uniformity of real orders. These findings are compatible with a pressure for information uniformity in the development and usage of natural languages.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/09/2015

Human languages order information efficiently

Most languages use the relative order between words to encode meaning re...
research
01/23/2021

On the Evolution of Word Order

Most natural languages have a predominant or fixed word order. For examp...
research
10/27/2021

When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer

While recent work on multilingual language models has demonstrated their...
research
09/08/2017

A Statistical Comparison of Some Theories of NP Word Order

A frequent object of study in linguistic typology is the order of elemen...
research
12/17/2015

Kauffman's adjacent possible in word order evolution

Word order evolution has been hypothesized to be constrained by a word o...
research
04/01/2021

Hereditary rigidity, separation and density In memory of Professor I.G. Rosenberg

We continue the investigation of systems of hereditarily rigid relations...

Please sign up or login with your details

Forgot password? Click here to reset