Defending Compositionality in Emergent Languages

06/09/2022
by   Michal Auersperger, et al.
0

Compositionality has traditionally been understood as a major factor in productivity of language and, more broadly, human cognition. Yet, recently, some research started to question its status, showing that artificial neural networks are good at generalization even without noticeable compositional behavior. We argue that some of these conclusions are too strong and/or incomplete. In the context of a two-agent communication game, we show that compositionality indeed seems essential for successful generalization when the evaluation is done on a proper dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2019

Linguistic generalization and compositionality in modern artificial neural networks

In the last decade, deep artificial neural networks have achieved astoun...
research
05/08/2023

How Do In-Context Examples Affect Compositional Generalization?

Compositional generalization–understanding unseen combinations of seen p...
research
06/04/2021

Emergent Communication of Generalizations

To build agents that can collaborate effectively with others, recent res...
research
04/07/2020

Emergent Language Generalization and Acquisition Speed are not tied to Compositionality

Studies of discrete languages emerging when neural agents communicate to...
research
05/22/2023

On the Correspondence between Compositionality and Imitation in Emergent Neural Communication

Compositionality is a hallmark of human language that not only enables l...
research
10/24/2019

Capacity, Bandwidth, and Compositionality in Emergent Language Learning

Many recent works have discussed the propensity, or lack thereof, for em...

Please sign up or login with your details

Forgot password? Click here to reset