Large Scale Distributed Collaborative Unlabeled Motion Planning with Graph Policy Gradients

02/11/2021
by   Arbaaz Khan, et al.
5

In this paper, we present a learning method to solve the unlabelled motion problem with motion constraints and space constraints in 2D space for a large number of robots. To solve the problem of arbitrary dynamics and constraints we propose formulating the problem as a multi-agent problem. We are able to demonstrate the scalability of our methods for a large number of robots by employing a graph neural network (GNN) to parameterize policies for the robots. The GNN reduces the dimensionality of the problem by learning filters that aggregate information among robots locally, similar to how a convolutional neural network is able to learn local features in an image. Additionally, by employing a GNN we are also able to overcome the computational overhead of training policies for a large number of robots by first training graph filters for a small number of robots followed by zero-shot policy transfer to a larger number of robots. We demonstrate the effectiveness of our framework through various simulations.

READ FULL TEXT

page 6

page 8

research
09/24/2019

Graph Policy Gradients for Large Scale Unlabeled Motion Planning with Constraints

In this paper, we present a learning method to solve the unlabelled moti...
research
07/08/2019

Graph Policy Gradients for Large Scale Robot Control

In this paper, we consider the problem of learning policies to control a...
research
03/02/2023

Technical report: Graph Neural Networks go Grammatical

This paper proposes a new GNN design strategy. This strategy relies on C...
research
11/02/2021

A Framework for Real-World Multi-Robot Systems Running Decentralized GNN-Based Policies

Graph Neural Networks (GNNs) are a paradigm-shifting neural architecture...
research
08/05/2022

Accelerating discrete dislocation dynamics simulations with graph neural networks

Discrete dislocation dynamics (DDD) is a widely employed computational m...
research
09/26/2020

Graph neural induction of value iteration

Many reinforcement learning tasks can benefit from explicit planning bas...
research
03/15/2023

Efficient Planning of Multi-Robot Collective Transport using Graph Reinforcement Learning with Higher Order Topological Abstraction

Efficient multi-robot task allocation (MRTA) is fundamental to various t...

Please sign up or login with your details

Forgot password? Click here to reset