Dynamic Channel Access and Power Control in Wireless Interference Networks via Multi-Agent Deep Reinforcement Learning

12/24/2021
by   Ziyang Lu, et al.
0

Due to the scarcity in the wireless spectrum and limited energy resources especially in mobile applications, efficient resource allocation strategies are critical in wireless networks. Motivated by the recent advances in deep reinforcement learning (DRL), we address multi-agent DRL-based joint dynamic channel access and power control in a wireless interference network. We first propose a multi-agent DRL algorithm with centralized training (DRL-CT) to tackle the joint resource allocation problem. In this case, the training is performed at the central unit (CU) and after training, the users make autonomous decisions on their transmission strategies with only local information. We demonstrate that with limited information exchange and faster convergence, DRL-CT algorithm can achieve 90 the combination of weighted minimum mean square error (WMMSE) algorithm for power control and exhaustive search for dynamic channel access. In the second part of this paper, we consider distributed multi-agent DRL scenario in which each user conducts its own training and makes its decisions individually, acting as a DRL agent. Finally, as a compromise between centralized and fully distributed scenarios, we consider federated DRL (FDRL) to approach the performance of DRL-CT with the use of a central unit in training while limiting the information exchange and preserving privacy of the users in the wireless system. Via simulation results, we show that proposed learning frameworks lead to efficient adaptive channel access and power control policies in dynamic environments.

READ FULL TEXT

page 3

page 6

page 7

page 8

page 9

page 12

page 13

page 14

research
05/12/2021

Adversarial Reinforcement Learning in Dynamic Channel Access and Power Control

Deep reinforcement learning (DRL) has recently been used to perform effi...
research
10/19/2020

Multi-Agent Deep Reinforcement Learning for Distributed Resource Management in Wirelessly Powered Communication Networks

This paper studies multi-agent deep reinforcement learning (MADRL) based...
research
12/17/2018

Optimizing Distributed MIMO Wi-Fi Networks with Deep Reinforcement Learning

This paper explores the feasibility of leveraging concepts from deep rei...
research
03/25/2020

Value-Decomposition Networks based Distributed Interference Control in Multi-platoon Groupcast

Platooning is considered one of the most representative 5G use cases. Du...
research
12/24/2021

Dynamic Channel Access via Meta-Reinforcement Learning

In this paper, we address the channel access problem in a dynamic wirele...
research
06/20/2019

When Multiple Agents Learn to Schedule: A Distributed Radio Resource Management Framework

Interference among concurrent transmissions in a wireless network is a k...

Please sign up or login with your details

Forgot password? Click here to reset