Scalable Planning and Learning Framework Development for Swarm-to-Swarm Engagement Problems

12/06/2022
by   Umut Demir, et al.
0

Development of guidance, navigation and control frameworks/algorithms for swarms attracted significant attention in recent years. That being said, algorithms for planning swarm allocations/trajectories for engaging with enemy swarms is largely an understudied problem. Although small-scale scenarios can be addressed with tools from differential game theory, existing approaches fail to scale for large-scale multi-agent pursuit evasion (PE) scenarios. In this work, we propose a reinforcement learning (RL) based framework to decompose to large-scale swarm engagement problems into a number of independent multi-agent pursuit-evasion games. We simulate a variety of multi-agent PE scenarios, where finite time capture is guaranteed under certain conditions. The calculated PE statistics are provided as a reward signal to the high level allocation layer, which uses an RL algorithm to allocate controlled swarm units to eliminate enemy swarm units with maximum efficiency. We verify our approach in large-scale swarm-to-swarm engagement simulations.

READ FULL TEXT

page 1

page 8

page 9

research
10/15/2022

A Scalable Reinforcement Learning Approach for Attack Allocation in Swarm to Swarm Engagement Problems

In this work we propose a reinforcement learning (RL) framework that con...
research
11/28/2020

A Probabilistic Guidance Approach to Swarm-to-Swarm Engagement Problem

This paper introduces a probabilistic guidance approach for the swarm-to...
research
06/03/2021

Three-agent Time-constrained Cooperative Pursuit-Evasion

This paper considers a pursuit-evasion scenario among three agents – an ...
research
01/10/2020

Optimal Disturbance Attenuation Approach with Measurement Feedback to Missile Guidance

Pursuit-evasion differential games using the Disturbance Attenuation app...
research
07/17/2018

Deep Reinforcement Learning for Swarm Systems

Recently, deep reinforcement learning (RL) methods have been applied suc...
research
08/18/2022

Group-based control of large-scale micro-robot swarms with on-board Physical Finite-State Machines

An important problem in microrobotics is how to control a large group of...
research
08/03/2021

SwarmPlay: Interactive Tic-tac-toe Board Game with Swarm of Nano-UAVs driven by Reinforcement Learning

Reinforcement learning (RL) methods have been actively applied in the fi...

Please sign up or login with your details

Forgot password? Click here to reset