Biases for Emergent Communication in Multi-agent Reinforcement Learning

12/11/2019
by   Tom Eccles, et al.
0

We study the problem of emergent communication, in which language arises because speakers and listeners must communicate information in order to solve tasks. In temporally extended reinforcement learning domains, it has proved hard to learn such communication without centralized training of agents, due in part to a difficult joint exploration problem. We introduce inductive biases for positive signalling and positive listening, which ease this problem. In a simple one-step environment, we demonstrate how these biases ease the learning problem. We also apply our methods to a more extended environment, showing that agents with these inductive biases achieve better performance, and analyse the resulting communication protocols.

READ FULL TEXT
research
06/10/2017

ACCNet: Actor-Coordinator-Critic Net for "Learning-to-Communicate" with Deep Multi-agent Reinforcement Learning

Communication is a critical factor for the big multi-agent world to stay...
research
07/05/2019

On Inductive Biases in Deep Reinforcement Learning

Many deep reinforcement learning algorithms contain inductive biases tha...
research
06/06/2023

Inductive Bias for Emergent Communication in a Continuous Setting

We study emergent communication in a multi-agent reinforcement learning ...
research
02/08/2021

Grid-to-Graph: Flexible Spatial Relational Inductive Biases for Reinforcement Learning

Although reinforcement learning has been successfully applied in many do...
research
10/15/2021

Shared Visual Representations of Drawing for Communication: How do different biases affect human interpretability and intent?

We present an investigation into how representational losses can affect ...
research
01/06/2020

Incentivizing the Emergence of Grounded Discrete Communication Between General Agents

We converted the recently developed BabyAI grid world platform to a send...
research
06/06/2019

Ease-of-Teaching and Language Structure from Emergent Communication

Artificial agents have been shown to learn to communicate when needed to...

Please sign up or login with your details

Forgot password? Click here to reset