DeepAI AI Chat
Log In Sign Up

A Multi-Agent Deep Reinforcement Learning based Spectrum Allocation Framework for D2D Communications

by   Zheng Li, et al.
Beijing University of Posts and Telecommunications

Device-to-device (D2D) communication has been recognized as a promising technique to improve spectrum efficiency. However, D2D transmission as an underlay causes severe interference, which imposes a technical challenge to spectrum allocation. Existing centralized schemes require global information, which can cause serious signaling overhead. While existing distributed solution requires frequent information exchange between users and cannot achieve global optimization. In this paper, a distributed spectrum allocation framework based on multi-agent deep reinforcement learning is proposed, named Neighbor-Agent Actor Critic (NAAC). NAAC uses neighbor users' historical information for centralized training but is executed distributedly without that information, which not only has no signal interaction during execution, but also utilizes cooperation between users to further optimize system performance. The simulation results show that the proposed framework can effectively reduce the outage probability of cellular links, improve the sum rate of D2D links and have good convergence.


Multi-Agent Deep Reinforcement Learning based Spectrum Allocation for D2D Underlay Communications

Device-to-device (D2D) communication underlay cellular networks is a pro...

A Multi-Agent Deep Reinforcement Learning based Spectrum Allocation Framework for D2D Underlay Communications

Device-to-device (D2D) underlay communication improves spectrum efficien...

Power Control and Channel Allocation for D2D Underlaid Cellular Networks

Device-to-Device (D2D) communications underlaying cellular networks is a...

Matching Game Based Framework for Two-Timescale Cooperative D2D Communication

We consider a cooperative device-to-device (D2D) communication system, w...

Ultra-dense Low Data Rate (UDLD) Communication in the THz

In the future, with the advent of Internet of Things (IoT), wireless sen...

Mode Selection and Spectrum Partition for D2D Inband Communications: A Physical Layer Security Perspective

This paper investigates from the physical layer security (PLS) perspecti...