Distributed multi-agent target search and tracking with Gaussian process and reinforcement learning

08/29/2023
by   Jigang Kim, et al.
0

Deploying multiple robots for target search and tracking has many practical applications, yet the challenge of planning over unknown or partially known targets remains difficult to address. With recent advances in deep learning, intelligent control techniques such as reinforcement learning have enabled agents to learn autonomously from environment interactions with little to no prior knowledge. Such methods can address the exploration-exploitation tradeoff of planning over unknown targets in a data-driven manner, eliminating the reliance on heuristics typical of traditional approaches and streamlining the decision-making pipeline with end-to-end training. In this paper, we propose a multi-agent reinforcement learning technique with target map building based on distributed Gaussian process. We leverage the distributed Gaussian process to encode belief over the target locations and efficiently plan over unknown targets. We evaluate the performance and transferability of the trained policy in simulation and demonstrate the method on a swarm of micro unmanned aerial vehicles with hardware experiments.

READ FULL TEXT

page 6

page 8

page 9

page 10

research
03/03/2023

Multi-Target Pursuit by a Decentralized Heterogeneous UAV Swarm using Deep Multi-Agent Reinforcement Learning

Multi-agent pursuit-evasion tasks involving intelligent targets are noto...
research
07/12/2023

DSSE: a drone swarm search environment

The Drone Swarm Search project is an environment, based on PettingZoo, t...
research
06/24/2022

Toward multi-target self-organizing pursuit in a partially observable Markov game

The multiple-target self-organizing pursuit (SOP) problem has wide appli...
research
12/16/2022

Reinforcement Learning for Agile Active Target Sensing with a UAV

Active target sensing is the task of discovering and classifying an unkn...
research
03/17/2021

Decentralized Reinforcement Learning for Multi-Target Search and Detection by a Team of Drones

Targets search and detection encompasses a variety of decision problems ...
research
09/17/2022

Sample-Efficient Multi-Agent Reinforcement Learning with Demonstrations for Flocking Control

Flocking control is a significant problem in multi-agent systems such as...
research
10/26/2021

The Value of Information When Deciding What to Learn

All sequential decision-making agents explore so as to acquire knowledge...

Please sign up or login with your details

Forgot password? Click here to reset