On Homophony and Rényi Entropy

09/28/2021
by   Tiago Pimentel, et al.
0

Homophony's widespread presence in natural languages is a controversial topic. Recent theories of language optimality have tried to justify its prevalence, despite its negative effects on cognitive processing time; e.g., Piantadosi et al. (2012) argued homophony enables the reuse of efficient wordforms and is thus beneficial for languages. This hypothesis has recently been challenged by Trott and Bergen (2020), who posit that good wordforms are more often homophonous simply because they are more phonotactically probable. In this paper, we join in on the debate. We first propose a new information-theoretic quantification of a language's homophony: the sample Rényi entropy. Then, we use this quantification to revisit Trott and Bergen's claims. While their point is theoretically sound, a specific methodological issue in their experiments raises doubts about their results. After addressing this issue, we find no clear pressure either towards or against homophony – a much more nuanced result than either Piantadosi et al.'s or Trott and Bergen's findings.

READ FULL TEXT
research
05/28/2021

Learning Approximate and Exact Numeral Systems via Reinforcement Learning

Recent work (Xu et al., 2020) has suggested that numeral systems in diff...
research
02/21/2022

Rewriting results in the language of compatibility

This is a reply to Muff, S. et al. (2022) Rewriting results sections in ...
research
09/15/2015

Dependency length minimization: Puzzles and Promises

In the recent issue of PNAS, Futrell et al. claims that their study of 3...
research
05/20/2023

Revisiting Entropy Rate Constancy in Text

The uniform information density (UID) hypothesis states that humans tend...
research
04/15/2021

The Effect of Efficient Messaging and Input Variability on Neural-Agent Iterated Language Learning

Natural languages commonly display a trade-off among different strategie...
research
10/11/2019

How Does Language Influence Documentation Workflow? Unsupervised Word Discovery Using Translations in Multiple Languages

For language documentation initiatives, transcription is an expensive re...
research
12/16/2022

A unified information-theoretic model of EEG signatures of human language processing

We advance an information-theoretic model of human language processing i...

Please sign up or login with your details

Forgot password? Click here to reset