Log In Sign Up

A Framework for Real-World Multi-Robot Systems Running Decentralized GNN-Based Policies

by   Jan Blumenkamp, et al.

Graph Neural Networks (GNNs) are a paradigm-shifting neural architecture to facilitate the learning of complex multi-agent behaviors. Recent work has demonstrated remarkable performance in tasks such as flocking, multi-agent path planning and cooperative coverage. However, the policies derived through GNN-based learning schemes have not yet been deployed to the real-world on physical multi-robot systems. In this work, we present the design of a system that allows for fully decentralized execution of GNN-based policies. We create a framework based on ROS2 and elaborate its details in this paper. We demonstrate our framework on a case-study that requires tight coordination between robots, and present first-of-a-kind results that show successful real-world deployment of GNN-based policies on a decentralized multi-robot system relying on Adhoc communication. A video demonstration of this case-study can be found online.


Message-Aware Graph Attention Networks for Large-Scale Multi-Robot Path Planning

The domains of transport and logistics are increasingly relying on auton...

Fully Decentralized Policies for Multi-Agent Systems: An Information Theoretic Approach

Learning cooperative policies for multi-agent systems is often challenge...

Graph Neural Networks for Decentralized Multi-Robot Submodular Action Selection

In this paper, we develop a learning-based approach for decentralized su...

Large Scale Distributed Collaborative Unlabeled Motion Planning with Graph Policy Gradients

In this paper, we present a learning method to solve the unlabelled moti...

Learning Connectivity for Data Distribution in Robot Teams

Many algorithms for control of multi-robot teams operate under the assum...

Learning Decentralized Strategies for a Perimeter Defense Game with Graph Neural Networks

We consider the problem of finding decentralized strategies for multi-ag...

A Sequential Composition Framework for Coordinating Multi-Robot Behaviors

A number of coordinated behaviors have been proposed for achieving speci...