DeepAI AI Chat
Log In Sign Up

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

01/22/2019
by   Fan Meng, et al.
Southeast University
Microsoft
The University of British Columbia
0

The model-based power allocation algorithm has been investigated for decades, but it requires the mathematical models to be analytically tractable and it usually has high computational complexity. Recently, the data-driven model-free machine learning enabled approaches are being rapidly developed to obtain near-optimal performance with affordable computational complexity, and deep reinforcement learning (DRL) is regarded as of great potential for future intelligent networks. In this paper, the DRL approaches are considered for power control in multi-user wireless communication cellular networks. Considering the cross-cell cooperation, the off-line/on-line centralized training and the distributed execution, we present a mathematical analysis for the DRL-based top-level design. The concrete DRL design is further developed based on this foundation, and policy-based REINFORCE, value-based deep Q learning (DQL), actor-critic deep deterministic policy gradient (DDPG) algorithms are proposed. Simulation results show that the proposed data-driven approaches outperform the state-of-art model-based methods on sum-rate performance, with good generalization power and faster processing speed. Furthermore, the proposed DDPG outperforms the REINFORCE and DQL in terms of both sum-rate performance and robustness, and can be incorporated into existing resource allocation schemes due to its generality.

READ FULL TEXT
12/07/2018

Power Allocation in Multi-user Cellular Networks With Deep Q Learning Approach

The model-driven power allocation (PA) algorithms in the wireless cellul...
04/30/2019

A Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell Networks

Optimal resource allocation is a fundamental challenge for dense and het...
09/07/2020

Centralized Distributed Deep Reinforcement Learning Methods for Downlink Sum-Rate Optimization

For a multi-cell, multi-user, cellular network downlink sum-rate maximiz...
02/18/2022

Toward a Smart Resource Allocation Policy via Artificial Intelligence in 6G Networks: Centralized or Decentralized?

In this paper, we design a new smart softwaredefined radio access networ...
02/10/2021

Deep Reinforcement Learning with Symmetric Prior for Predictive Power Allocation to Mobile Users

Deep reinforcement learning has been applied for a variety of wireless t...
06/26/2020

Distributed Uplink Beamforming in Cell-Free Networks Using Deep Reinforcement Learning

The emergence of new wireless technologies together with the requirement...

Code Repositories