DeepAI AI Chat
Log In Sign Up

Cooperative Multi-Agent Deep Reinforcement Learning for Reliable and Energy-Efficient Mobile Access via Multi-UAV Control

10/03/2022
by   Chanyoung Park, et al.
Korea University
Intel
AJOU University
0

This paper addresses a novel multi-agent deep reinforcement learning (MADRL)-based multiple unmanned aerial vehicles (UAV) positioning algorithm for reliable mobile access services (i.e., UAVs work as mobile base stations), where the MADRL is designed by the concept of centralized training and distributed execution (CTDE) for multi-agent cooperation and coordination. The reliable mobile access services can be achieved in following two ways, i.e., (i) energy-efficient UAV operation and (ii) reliable wireless communication services. For energy-efficient UAV operation, the reward of our proposed MADRL algorithm contains the features for UAV energy consumption models in order to realize efficient operations. Furthermore, for reliable wireless communication services, the quality of service (QoS) requirements of individual users are considered as a part of rewards and 60GHz mmWave radio is used for mobile access. This paper considers the 60GHz mmWave access for utilizing the benefits of (i) ultra-wide-bandwidth for multi-Gbps high-speed communications and (ii) high-directional communications for spatial reuse that is obviously good for densely deployed users. Lastly, the performance of our proposed MADRL-based multi-UAV positioning algorithm is evaluated; and it can be confirmed that the proposed algorithm outperforms the other existing algorithms.

READ FULL TEXT

page 1

page 8

page 15

page 16

01/15/2022

Cooperative Multi-Agent Deep Reinforcement Learning for Reliable Surveillance via Autonomous Multi-UAV Control

CCTV-based surveillance using unmanned aerial vehicles (UAVs) is conside...
02/09/2023

Quantum Multi-Agent Actor-Critic Networks for Cooperative Mobile Access in Multi-UAV Systems

This paper proposes a novel quantum multi-agent actor-critic networks (Q...
11/15/2022

Deep Reinforcement Learning for Combined Coverage and Resource Allocation in UAV-aided RAN-slicing

Network slicing is a well assessed approach enabling virtualization of t...
08/02/2022

Evaluating Inter-Operator Cooperation Scenarios to Save Radio Access Network Energy

Reducing energy consumption is crucial to reduce the human debt's with r...
06/30/2023

Federated Multi-Agent Deep Reinforcement Learning for Dynamic and Flexible 3D Operation of 5G Multi-MAP Networks

This paper addresses the efficient management of Mobile Access Points (M...
05/18/2020

An Energy-Efficient Event-Based MIMO Communication Scheme for UAV Formation Control

We consider a leader-follower formation control setup as an example for ...