Improving Coordination in Multi-Agent Deep Reinforcement Learning through Memory-driven Communication

01/12/2019
by   Emanuele Pesce, et al.
12

Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced with a task requiring coordination and synchronisation skills, inter-agent communication plays an essential role. In this work, we propose a framework for multi-agent training using deep deterministic policy gradients that enables the concurrent, end-to-end learning of an explicit communication protocol through a memory device. During training, the agents learn to perform read and write operations enabling them to infer a shared representation of the world. We empirically demonstrate that concurrent learning of the communication device and individual policies can improve inter-agent coordination and performance, and illustrate how different communication patterns can emerge for different tasks.

READ FULL TEXT

page 7

page 16

research
12/22/2017

Federated Control with Hierarchical Multi-Agent Deep Reinforcement Learning

We present a framework combining hierarchical and multi-agent deep reinf...
research
12/03/2018

Multi-agent Deep Reinforcement Learning with Extremely Noisy Observations

Multi-agent reinforcement learning systems aim to provide interacting ag...
research
03/07/2019

Concurrent Meta Reinforcement Learning

State-of-the-art meta reinforcement learning algorithms typically assume...
research
01/25/2019

Emergent Linguistic Phenomena in Multi-Agent Communication Games

In this work, we propose a computational framework in which agents equip...
research
02/12/2020

Connectivity-driven Communication in Multi-agent Reinforcement Learning through Diffusion Processes on Graphs

We discuss the problem of learning collaborative behaviour in multi-agen...
research
06/21/2021

Curriculum-Driven Multi-Agent Learning and the Role of Implicit Communication in Teamwork

We propose a curriculum-driven learning strategy for solving difficult m...
research
06/14/2022

Universally Expressive Communication in Multi-Agent Reinforcement Learning

Allowing agents to share information through communication is crucial fo...

Please sign up or login with your details

Forgot password? Click here to reset