Emergent Language Generalization and Acquisition Speed are not tied to Compositionality

04/07/2020
by   Eugene Kharitonov, et al.
0

Studies of discrete languages emerging when neural agents communicate to solve a joint task often look for evidence of compositional structure. This stems for the expectation that such a structure would allow languages to be acquired faster by the agents and enable them to generalize better. We argue that these beneficial properties are only loosely connected to compositionality. In two experiments, we demonstrate that, depending on the task, non-compositional languages might show equal, or better, generalization performance and acquisition speed than compositional ones. Further research in the area should be clearer about what benefits are expected from compositionality, and how the latter would lead to them.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2019

The Emergence of Compositional Languages for Numeric Concepts Through Iterated Learning in Neural Agents

Since first introduced, computer simulation has been an increasingly imp...
research
10/24/2019

Capacity, Bandwidth, and Compositionality in Emergent Language Learning

Many recent works have discussed the propensity, or lack thereof, for em...
research
05/22/2023

On the Correspondence between Compositionality and Imitation in Emergent Neural Communication

Compositionality is a hallmark of human language that not only enables l...
research
02/20/2022

Understanding Robust Generalization in Learning Regular Languages

A key feature of human intelligence is the ability to generalize beyond ...
research
06/09/2022

Defending Compositionality in Emergent Languages

Compositionality has traditionally been understood as a major factor in ...
research
12/15/2020

Are we Forgetting about Compositional Optimisers in Bayesian Optimisation?

Bayesian optimisation presents a sample-efficient methodology for global...
research
02/19/2019

Measuring Compositionality in Representation Learning

Many machine learning algorithms represent input data with vector embedd...

Please sign up or login with your details

Forgot password? Click here to reset