Decentralised Active Perception in Continuous Action Spaces for the Coordinated Escort Problem

05/03/2023
by   Rhett Hull, et al.
0

We consider the coordinated escort problem, where a decentralised team of supporting robots implicitly assist the mission of higher-value principal robots. The defining challenge is how to evaluate the effect of supporting robots' actions on the principal robots' mission. To capture this effect, we define two novel auxiliary reward functions for supporting robots called satisfaction improvement and satisfaction entropy, which computes the improvement in probability of mission success, or the uncertainty thereof. Given these reward functions, we coordinate the entire team of principal and supporting robots using decentralised cross entropy method (Dec-CEM), a new extension of CEM to multi-agent systems based on the product distribution approximation. In a simulated object avoidance scenario, our planning framework demonstrates up to two-fold improvement in task satisfaction against conventional decoupled information gathering.The significance of our results is to introduce a new family of algorithmic problems that will enable important new practical applications of heterogeneous multi-robot systems.

READ FULL TEXT

page 1

page 6

research
11/13/2018

Team NimbRo at MBZIRC 2017: Fast Landing on a Moving Target and Treasure Hunting with a Team of MAVs

The Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2017 has...
research
09/17/2019

Inferring and Learning Multi-Robot Policies by Observing an Expert

In this paper we present a technique for learning how to solve a multi-r...
research
09/21/2021

Distributed Mission Planning of Complex Tasks for Heterogeneous Multi-Robot Teams

In this paper, we propose a distributed multi-stage optimization method ...
research
09/12/2019

A Reinforcement Learning Framework for Sequencing Multi-Robot Behaviors

Given a list of behaviors and associated parameterized controllers for s...
research
02/08/2019

A Framework for Autonomous Robot Deployment with Perfect Demand Satisfaction using Virtual Forces

In many applications, robots autonomous deployment is preferable and som...
research
03/10/2021

Hiding Leader's Identity in Leader-Follower Navigation through Multi-Agent Reinforcement Learning

Leader-follower navigation is a popular class of multi-robot algorithms ...

Please sign up or login with your details

Forgot password? Click here to reset