Distributed Multi-Agent Deep Reinforcement Learning for Robust Coordination against Noise

05/19/2022
by   Yoshinari Motokawa, et al.
0

In multi-agent systems, noise reduction techniques are important for improving the overall system reliability as agents are required to rely on limited environmental information to develop cooperative and coordinated behaviors with the surrounding agents. However, previous studies have often applied centralized noise reduction methods to build robust and versatile coordination in noisy multi-agent environments, while distributed and decentralized autonomous agents are more plausible for real-world application. In this paper, we introduce a distributed attentional actor architecture model for a multi-agent system (DA3-X), using which we demonstrate that agents with DA3-X can selectively learn the noisy environment and behave cooperatively. We experimentally evaluate the effectiveness of DA3-X by comparing learning methods with and without DA3-X and show that agents with DA3-X can achieve better performance than baseline agents. Furthermore, we visualize heatmaps of attentional weights from the DA3-X to analyze how the decision-making process and coordinated behavior are influenced by noise.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

research
09/20/2021

Promoting Coordination Through Electing First-moveAgent in Multi-Agent Reinforcement Learning

Learning to coordinate among multiple agents is an essential problem in ...
research
04/20/2023

Interpretability for Conditional Coordinated Behavior in Multi-Agent Reinforcement Learning

We propose a model-free reinforcement learning architecture, called dist...
research
10/22/2019

Distributed interference cancellation in multi-agent scenarios

This paper considers the problem of detecting impaired and noisy nodes o...
research
09/05/2017

Robust Semi-Cooperative Multi-Agent Coordination in the Presence of Stochastic Disturbances

This paper presents a robust distributed coordination protocol that achi...
research
10/16/2020

PRIMAL2: Pathfinding via Reinforcement and Imitation Multi-Agent Learning – Lifelong

Multi-agent path finding (MAPF) is an indispensable component of large-s...
research
04/05/2022

Multi-Agent Distributed Reinforcement Learning for Making Decentralized Offloading Decisions

We formulate computation offloading as a decentralized decision-making p...
research
06/30/2020

Robust Multi-Agent Task Assignment in Failure-Prone and Adversarial Environments

The problem of assigning agents to tasks is a central computational chal...

Please sign up or login with your details

Forgot password? Click here to reset