Intention Propagation for Multi-agent Reinforcement Learning

04/19/2020
by   Chao Qu, et al.
11

A hallmark of an AI agent is to mimic human beings to understand and interact with others. In this paper, we propose a collaborative multi-agent reinforcement learning algorithm to learn a joint policy through the interactions over agents. To make a joint decision over the group, each agent makes an initial decision and tells its policy to its neighbors. Then each agent modifies its own policy properly based on received messages and spreads out its plan. As this intention propagation procedure goes on, we prove that it converges to a mean-field approximation of the joint policy with the framework of neural embedded probabilistic inference. We evaluate our algorithm on several large scale challenging tasks and demonstrate that it outperforms previous state-of-the-arts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/11/2022

Graphon Mean-Field Control for Cooperative Multi-Agent Reinforcement Learning

The marriage between mean-field theory and reinforcement learning has sh...
research
04/25/2023

Partially Observable Mean Field Multi-Agent Reinforcement Learning Based on Graph-Attention

Traditional multi-agent reinforcement learning algorithms are difficultl...
research
12/02/2021

Multi-Agent Intention Sharing via Leader-Follower Forest

Intention sharing is crucial for efficient cooperation under partially o...
research
03/06/2022

Depthwise Convolution for Multi-Agent Communication with Enhanced Mean-Field Approximation

Multi-agent settings remain a fundamental challenge in the reinforcement...
research
01/27/2019

Value Propagation for Decentralized Networked Deep Multi-agent Reinforcement Learning

We consider the networked multi-agent reinforcement learning (MARL) prob...
research
02/21/2021

Dealing with Non-Stationarity in Multi-Agent Reinforcement Learning via Trust Region Decomposition

Non-stationarity is one thorny issue in multi-agent reinforcement learni...
research
07/13/2023

Layered controller synthesis for dynamic multi-agent systems

In this paper we present a layered approach for multi-agent control prob...

Please sign up or login with your details

Forgot password? Click here to reset