Graphical Games for UAV Swarm Control Under Time-Varying Communication Networks

05/04/2022
by   Malintha Fernando, et al.
0

We propose a unified framework for coordinating Unmanned Aerial Vehicle (UAV) swarms operating under time-varying communication networks. Our framework builds on the concept of graphical games, which we argue provides a compelling paradigm to subsume the interaction structures found in networked UAV swarms thanks to the shared local neighborhood properties. We present a general-sum, factorizable payoff function for cooperative UAV swarms based on the aggregated local states and yield a Nash equilibrium for the stage games. Further, we propose a decomposition-based approach to solve stage-graphical games in a scalable and decentralized fashion by approximating virtual, mean neighborhoods. Finally, we discuss extending the proposed framework toward general-sum stochastic games by leveraging deep Q-learning and model-predictive control.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/08/2021

CoCo Games: Graphical Game-Theoretic Swarm Control for Communication-Aware Coverage

We present a novel approach to maximize the communication-aware coverage...
research
07/06/2023

A Robust Characterization of Nash Equilibrium

We give a robust characterization of Nash equilibrium by postulating coh...
research
01/27/2022

Decentralized Fictitious Play Converges Near a Nash Equilibrium in Near-Potential Games

We investigate convergence of decentralized fictitious play (DFP) in nea...
research
03/29/2020

Graphical Games and Decomposition

We consider graphical games as introduced by Kearns et al. (2001). First...
research
11/15/2019

Resource Awareness in Unmanned Aerial Vehicle-Assisted Mobile-Edge Computing Systems

This paper investigates an unmanned aerial vehicle (UAV)-assisted mobile...
research
04/24/2020

Continuous Deep Hierarchical Reinforcement Learning for Ground-Air Swarm Shepherding

The control and guidance of multi-robots (swarm) is a non-trivial proble...
research
12/10/2020

A Probabilistic Graphical Model Foundation for Enabling Predictive Digital Twins at Scale

A unifying mathematical formulation is needed to move from one-off digit...

Please sign up or login with your details

Forgot password? Click here to reset