On the Spontaneous Emergence of Discrete and Compositional Signals

04/30/2020
by   Nur Geffen Lan, et al.
0

We propose a general framework to study language emergence through signaling games with neural agents. Using a continuous latent space, we are able to (i) train using backpropagation, (ii) show that discrete messages nonetheless naturally emerge. We explore whether categorical perception effects follow and show that the messages are not compositional.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2018

Compositional Obverter Communication Learning From Raw Visual Input

One of the distinguishing aspects of human language is its compositional...
research
03/15/2017

Emergence of Grounded Compositional Language in Multi-Agent Populations

By capturing statistical patterns in large corpora, machine learning has...
research
04/11/2018

Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Input

The ability of algorithms to evolve or learn (compositional) communicati...
research
11/11/2021

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication

Communication is compositional if complex signals can be represented as ...
research
04/19/2019

Emergence of Compositional Language with Deep Generational Transmission

Consider a collaborative task that requires communication. Two agents ar...
research
12/07/2020

Learning Compositional Negation in Populations of Roth-Erev and Neural Agents

Agent-based models and signalling games are useful tools with which to s...
research
01/25/2021

Deep learning based mixed-dimensional GMM for characterizing variability in CryoEM

The function of most protein molecules involves structural flexibility a...

Please sign up or login with your details

Forgot password? Click here to reset