Learning to Ground Decentralized Multi-Agent Communication with Contrastive Learning

03/07/2022
by   Yat Long Lo, et al.
0

For communication to happen successfully, a common language is required between agents to understand information communicated by one another. Inducing the emergence of a common language has been a difficult challenge to multi-agent learning systems. In this work, we introduce an alternative perspective to the communicative messages sent between agents, considering them as different incomplete views of the environment state. Based on this perspective, we propose a simple approach to induce the emergence of a common language by maximizing the mutual information between messages of a given trajectory in a self-supervised manner. By evaluating our method in communication-essential environments, we empirically show how our method leads to better learning performance and speed, and learns a more consistent common language than existing methods, without introducing additional learning parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/03/2023

Learning to Communicate using Contrastive Learning

Communication is a powerful tool for coordination in multi-agent RL. But...
research
10/28/2021

Learning to Ground Multi-Agent Communication with Autoencoders

Communication requires having a common language, a lingua franca, betwee...
research
05/31/2019

Information Minimization In Emergent Languages

There is a growing interest in studying the languages emerging when neur...
research
04/23/2017

Translating Neuralese

Several approaches have recently been proposed for learning decentralize...
research
10/11/2019

Learning Nearly Decomposable Value Functions Via Communication Minimization

Reinforcement learning encounters major challenges in multi-agent settin...
research
04/12/2022

An Analysis of Discretization Methods for Communication Learning with Multi-Agent Reinforcement Learning

Communication is crucial in multi-agent reinforcement learning when agen...
research
06/03/2020

Emergent Multi-Agent Communication in the Deep Learning Era

The ability to cooperate through language is a defining feature of human...

Please sign up or login with your details

Forgot password? Click here to reset