Co-evolution of language and agents in referential games

01/10/2020
by   Gautier Dagan, et al.
0

Referential games offer a grounded learning environment for neural agents, that accounts for the functional aspects of language. However, they fail to account for another fundamental aspect of human language: Because languages are transmitted from generation to generation, they have to be learnable by new language users, which makes them subject to cultural evolution. Recent work has shown that incorporating cultural evolution in referential game results in considerable improvements in the properties of the languages that emerge in the game. In this work, we first substantiate this claim with a different data set and a wider array of evaluation metrics. Then, drawing inspiration from linguistic theories of human language evolution, we consider a scenario in which not only cultural but also genetic evolution is integrated. As our core contribution, we introduce the Language Transmission Engine, in which cultural evolution of the language is combined with genetic evolution of the agents' architecture. We show that this co-evolution scenario leads to across-the-board improvements on all considered metrics. These results stress that cultural evolution is important for language emergence studies, but also the suitability of the architecture itself should be considered.

READ FULL TEXT

page 4

page 7

research
04/19/2019

Emergence of Compositional Language with Deep Generational Transmission

Consider a collaborative task that requires communication. Two agents ar...
research
03/01/2022

Learning Robust Real-Time Cultural Transmission without Human Data

Cultural transmission is the domain-general social skill that allows age...
research
03/11/2011

Language, Emotions, and Cultures: Emotional Sapir-Whorf Hypothesis

An emotional version of Sapir-Whorf hypothesis suggests that differences...
research
07/28/2021

Growing knowledge culturally across generations to solve novel, complex tasks

Knowledge built culturally across generations allows humans to learn far...
research
02/11/2016

On the emergence of syntactic structures: quantifying and modelling duality of patterning

The complex organization of syntax in hierarchical structures is one of ...
research
03/09/2017

The cognitive roots of regularization in language

Regularization occurs when the output a learner produces is less variabl...
research
07/16/2019

Modeling competitive evolution of multiple languages

Increasing evidence demonstrates that in many places language coexistenc...

Please sign up or login with your details

Forgot password? Click here to reset