Federated Multi-Agent Deep Reinforcement Learning for Dynamic and Flexible 3D Operation of 5G Multi-MAP Networks

by   Esteban Catté, et al.

This paper addresses the efficient management of Mobile Access Points (MAPs), which are Unmanned Aerial Vehicles (UAV), in 5G networks. We propose a two-level hierarchical architecture, which dynamically reconfigures the network while considering Integrated Access-Backhaul (IAB) constraints. The high-layer decision process determines the number of MAPs through consensus, and we develop a joint optimization process to account for co-dependence in network self-management. In the low-layer, MAPs manage their placement using a double-attention based Deep Reinforcement Learning (DRL) model that encourages cooperation without retraining. To improve generalization and reduce complexity, we propose a federated mechanism for training and sharing one placement model for every MAP in the low-layer. Additionally, we jointly optimize the placement and backhaul connectivity of MAPs using a multi-objective reward function, considering the impact of varying MAP placement on wireless backhaul connectivity.


Dual-Attention Deep Reinforcement Learning for Multi-MAP 3D Trajectory Optimization in Dynamic 5G Networks

5G and beyond networks need to provide dynamic and efficient infrastruct...

Cost-Efficient and QoS-Aware User Association and 3D Placement of 6G Aerial Mobile Access Points

6G networks require a flexible infrastructure to dynamically provide ubi...

Placement Optimization of Aerial Base Stations with Deep Reinforcement Learning

Unmanned aerial vehicles (UAVs) can be utilized as aerial base stations ...

Traffic-Aware UAV Placement Using a Generalizable Deep Reinforcement Learning Methodology

Unmanned Aerial Vehicles (UAVs) acting as Flying Access Points (FAPs) ar...

Aesthetic Photo Collage with Deep Reinforcement Learning

Photo collage aims to automatically arrange multiple photos on a given c...

Coded Caching via Federated Deep Reinforcement Learning in Fog Radio Access Networks

In this paper, the placement strategy design of coded caching in fog-rad...

Please sign up or login with your details

Forgot password? Click here to reset