DeepAI AI Chat
Log In Sign Up

Decentralized Computation Offloading With Cooperative UAVs: Multi-Agent Deep Reinforcement Learning Perspective

by   Sangwon Hwang, et al.
The University of Texas at Austin
Korea University

Limited computing resources of internet-of-things (IoT) nodes incur prohibitive latency in processing input data. This triggers new research opportunities toward task offloading systems where edge servers handle intensive computations of IoT devices. Deploying the computing servers at existing base stations may not be sufficient to support IoT nodes operating in a harsh environment. This requests mobile edge servers to be mounted on unmanned aerial vehicles (UAVs) that provide on-demand mobile edge computing (MEC) services. Time-varying offloading demands and mobility of UAVs need a joint design of the optimization variables for all time instances. Therefore, an online decision mechanism is essential for UAV-aided MEC networks. This article presents an overview of recent deep reinforcement learning (DRL) approaches where decisions about UAVs and IoT nodes are taken in an online manner. Specifically, joint optimization over task offloading, resource allocation, and UAV mobility is addressed from the DRL perspective. For the decentralized implementation, a multi-agent DRL method is proposed where multiple intelligent UAVs cooperatively determine their computations and communication policies without central coordination. Numerical results demonstrate that the proposed decentralized learning strategy is superior to existing DRL solutions. The proposed framework sheds light on the viability of the decentralized DRL techniques in designing self-organizing IoT networks.


page 1

page 4

page 8

page 9

page 10

page 13

page 14

page 16


A Survey on UAV-enabled Edge Computing: Resource Management Perspective

Edge computing facilitates low-latency services at the network's edge by...

Deep Reinforcement Learning for Backscatter-Aided Data Offloading in Mobile Edge Computing

Wireless network optimization has been becoming very challenging as the ...

Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial

Deep Reinforcement Learning (DRL) has recently witnessed significant adv...

A Resource Allocation Scheme for Energy Demand Management in 6G-enabled Smart Grid

Smart grid (SG) systems enhance grid resilience and efficient operation,...

Deep Reinforcement Learning Based Multi-Access Edge Computing Schedule for Internet of Vehicle

As intelligent transportation systems been implemented broadly and unman...