Structural Inductive Biases in Emergent Communication

07/24/2021
by   Agnieszka Słowik, et al.
0

In order to communicate, humans flatten a complex representation of ideas and their attributes into a single word or a sentence. We investigate the impact of representation learning in artificial agents by developing graph referential games. We empirically show that agents parametrized by graph neural networks develop a more compositional language compared to bag-of-words and sequence models, which allows them to systematically generalize to new combinations of familiar features.

READ FULL TEXT
research
07/24/2021

Analyzing Structural Priors in Multi-Agent Communication

Human language and thought are characterized by the ability to systemati...
research
11/11/2021

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication

Communication is compositional if complex signals can be represented as ...
research
07/24/2021

Towards Graph Representation Learning in Emergent Communication

Recent findings in neuroscience suggest that the human brain represents ...
research
04/06/2018

Compositional Obverter Communication Learning From Raw Visual Input

One of the distinguishing aspects of human language is its compositional...
research
02/08/2021

Grid-to-Graph: Flexible Spatial Relational Inductive Biases for Reinforcement Learning

Although reinforcement learning has been successfully applied in many do...
research
06/04/2021

Emergent Communication of Generalizations

To build agents that can collaborate effectively with others, recent res...
research
06/29/2020

Structural Landmarking and Interaction Modelling: on Resolution Dilemmas in Graph Classification

Graph neural networks are promising architecture for learning and infere...

Please sign up or login with your details

Forgot password? Click here to reset