DeepAI AI Chat
Log In Sign Up

Reinforcement Learning for Self-Organization and Power Control of Two-Tier Heterogeneous Networks

by   Roohollah Amiri, et al.

Self-organizing networks (SONs) can help manage the severe interference in dense heterogeneous networks (HetNets). Given their need to automatically configure power and other settings, machine learning is a promising tool for data-driven decision making in SONs. In this paper, a HetNet is modeled as a dense two-tier network with conventional macrocells overlaid with denser small cells (e.g. femto or pico cells). First, a distributed framework based on multi-agent Markov decision process is proposed that models the power optimization problem in the network. Second, we present a systematic approach for designing a reward function based on the optimization problem. Third, we introduce Q-learning based distributed power allocation algorithm (Q-DPA) as a self-organizing mechanism that enables ongoing transmit power adaptation as new small cells are added to the network. Further, the sample complexity of the Q-DPA algorithm to achieve ϵ-optimality with high probability is provided. We demonstrate, at density of several thousands femtocells per km^2, the required quality of service of a macrocell user can be maintained via the proper selection of independent or cooperative learning and appropriate Markov state models.


A Machine Learning Approach for Power Allocation in HetNets Considering QoS

There is an increase in usage of smaller cells or femtocells to improve ...

Distributed-Training-and-Execution Multi-Agent Reinforcement Learning for Power Control in HetNet

In heterogeneous networks (HetNets), the overlap of small cells and the ...

Transmit Power Control for Indoor Small Cells: A Method Based on Federated Reinforcement Learning

Setting the transmit power setting of 5G cells has been a long-term topi...

DQN-Based Multi-User Power Allocation for Hybrid RF/VLC Networks

In this paper, a Deep Q-Network (DQN) based multi-agent multi-user power...

A Q-Learning-based Approach for Distributed Beam Scheduling in mmWave Networks

We consider the problem of distributed downlink beam scheduling and powe...

A novel approach for multi-agent cooperative pursuit to capture grouped evaders

An approach of mobile multi-agent pursuit based on application of self-o...