A Reinforcement Learning Framework for Sequencing Multi-Robot Behaviors

09/12/2019
by   Pietro Pierpaoli, et al.
0

Given a list of behaviors and associated parameterized controllers for solving different individual tasks, we study the problem of selecting an optimal sequence of coordinated behaviors in multi-robot systems for completing a given mission, which could not be handled by any single behavior. In addition, we are interested in the case where partial information of the underlying mission is unknown, therefore, the robots must cooperatively learn this information through their course of actions. Such problem can be formulated as an optimal decision problem in multi-robot systems, however, it is in general intractable due to modeling imperfections and the curse of dimensionality of the decision variables. To circumvent these issues, we first consider an alternate formulation of the original problem through introducing a sequence of behaviors' switching times. Our main contribution is then to propose a novel reinforcement learning based method, that combines Q-learning and online gradient descent, for solving this reformulated problem. In particular, the optimal sequence of the robots' behaviors is found by using Q-learning while the optimal parameters of the associated controllers are obtained through an online gradient descent method. Finally, to illustrate the effectiveness of our proposed method we implement it on a team of differential-drive robots for solving two different missions, namely, convoy protection and object manipulation.

READ FULL TEXT
research
01/28/2019

The Emergence of Complex Bodyguard Behavior Through Multi-Agent Reinforcement Learning

In this paper we are considering a scenario where a team of robot bodygu...
research
09/17/2019

Inferring and Learning Multi-Robot Policies by Observing an Expert

In this paper we present a technique for learning how to solve a multi-r...
research
10/03/2019

Behavior Mixing with Minimum Global and Subgroup Connectivity Maintenance for Large-Scale Multi-Robot Systems

In many cases the multi-robot systems are desired to execute simultaneou...
research
12/18/2020

Online Connectivity-aware Dynamic Deployment for Heterogeneous Multi-Robot Systems

In this paper, we consider the dynamic multi-robot distribution problem ...
research
05/03/2023

Decentralised Active Perception in Continuous Action Spaces for the Coordinated Escort Problem

We consider the coordinated escort problem, where a decentralised team o...
research
07/17/2020

Multi-robot Cooperative Object Transportation using Decentralized Deep Reinforcement Learning

Object transportation could be a challenging problem for a single robot ...
research
07/17/2019

A Sequential Composition Framework for Coordinating Multi-Robot Behaviors

A number of coordinated behaviors have been proposed for achieving speci...

Please sign up or login with your details

Forgot password? Click here to reset