Deep Reinforcement Learning for Multi-Agent Non-Cooperative Power Control in Heterogeneous Networks

04/25/2020
by   Lin Zhang, et al.
0

We consider a typical heterogeneous network (HetNet), in which multiple access points (APs) are deployed to serve users by reusing the same spectrum band. Since different APs and users may cause severe interference to each other, advanced power control techniques are needed to manage the interference and enhance the sum-rate of the whole network. Conventional power control techniques first collect instantaneous global channel state information (CSI) and then calculate sub-optimal solutions. Nevertheless, it is challenging to collect instantaneous global CSI in the HetNet, in which global CSI typically changes fast. In this paper, we exploit deep reinforcement learning (DRL) to design a multi-agent non-cooperative power control algorithm in the HetNet. To be specific, by treating each AP as an agent with a local deep neural network (DNN), we propose a multiple-actor-shared-critic (MASC) method to train the local DNNs separately in an online trial-and-error manner. With the proposed algorithm, each AP can independently use the local DNN to control the transmit power with only local observations. Simulations results show that the proposed algorithm outperforms the conventional power control algorithms in terms of both the converged average sum-rate and the computational complexity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/15/2022

Distributed-Training-and-Execution Multi-Agent Reinforcement Learning for Power Control in HetNet

In heterogeneous networks (HetNets), the overlap of small cells and the ...
research
03/25/2023

Distributed Multi-Agent Deep Q-Learning for Fast Roaming in IEEE 802.11ax Wi-Fi Systems

The innovation of Wi-Fi 6, IEEE 802.11ax, was be approved as the next si...
research
09/14/2020

Deep Actor-Critic Learning for Distributed Power Control in Wireless Mobile Networks

Deep reinforcement learning offers a model-free alternative to supervise...
research
08/01/2018

Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks

This work demonstrates the potential of deep reinforcement learning tech...
research
07/26/2018

Towards Optimal Power Control via Ensembling Deep Neural Networks

A deep neural network (DNN) based power control method is proposed, whic...
research
04/01/2019

Distributed Power Control for Large Energy Harvesting Networks: A Multi-Agent Deep Reinforcement Learning Approach

In this paper, we develop a multi-agent reinforcement learning (MARL) fr...
research
06/16/2020

Multi-Agent Reinforcement Learning for Adaptive User Association in Dynamic mmWave Networks

Network densification and millimeter-wave technologies are key enablers ...

Please sign up or login with your details

Forgot password? Click here to reset