Multi-Agent Belief Sharing through Autonomous Hierarchical Multi-Level Clustering

07/21/2021
by   Mirco Theile, et al.
0

Coordination in multi-agent systems is challenging for agile robots such as unmanned aerial vehicles (UAVs), where relative agent positions frequently change due to unconstrained movement. The problem is exacerbated through the individual take-off and landing of agents for battery recharging leading to a varying number of active agents throughout the whole mission. This work proposes autonomous hierarchical multi-level clustering (MLC), which forms a clustering hierarchy utilizing decentralized methods. Through periodic cluster maintenance executed by cluster-heads, stable multi-level clustering is achieved. The resulting hierarchy is used as a backbone to solve the communication problem for locally-interactive applications such as UAV tracking problems. Using observation aggregation, compression, and dissemination, agents share local observations throughout the hierarchy, giving every agent a total system belief with spatially dependent resolution and freshness. Extensive simulations show that MLC yields a stable cluster hierarchy under different motion patterns and that the proposed belief sharing is highly applicable in wildfire front monitoring scenarios.

READ FULL TEXT

page 1

page 13

research
01/18/2021

HAMMER: Multi-Level Coordination of Reinforcement Learning Agents via Learned Messaging

Cooperative multi-agent reinforcement learning (MARL) has achieved signi...
research
11/06/2020

Multi-Agent Decentralized Belief Propagation on Graphs

We consider the problem of interactive partially observable Markov decis...
research
02/08/2023

Policy Evaluation in Decentralized POMDPs with Belief Sharing

Most works on multi-agent reinforcement learning focus on scenarios wher...
research
01/21/2023

Decentralized Multi-agent Filtering

This paper addresses the considerations that comes along with adopting d...
research
06/16/2023

Creating Multi-Level Skill Hierarchies in Reinforcement Learning

What is a useful skill hierarchy for an autonomous agent? We propose an ...
research
11/02/2022

Cluster Assignment in Multi-Agent Systems : Sparsity Bounds and Fault Tolerance

We study cluster assignment in homogeneous diffusive multi-agent network...
research
11/29/2021

Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning

Safety is the primary concern when it comes to air traffic. In-flight sa...

Please sign up or login with your details

Forgot password? Click here to reset