Reinforcement Learning for Self-Organization and Power Control of Two-Tier Heterogeneous Networks

12/23/2018
by   Roohollah Amiri, et al.
0

Self-organizing networks (SONs) can help manage the severe interference in dense heterogeneous networks (HetNets). Given their need to automatically configure power and other settings, machine learning is a promising tool for data-driven decision making in SONs. In this paper, a HetNet is modeled as a dense two-tier network with conventional macrocells overlaid with denser small cells (e.g. femto or pico cells). First, a distributed framework based on multi-agent Markov decision process is proposed that models the power optimization problem in the network. Second, we present a systematic approach for designing a reward function based on the optimization problem. Third, we introduce Q-learning based distributed power allocation algorithm (Q-DPA) as a self-organizing mechanism that enables ongoing transmit power adaptation as new small cells are added to the network. Further, the sample complexity of the Q-DPA algorithm to achieve ϵ-optimality with high probability is provided. We demonstrate, at density of several thousands femtocells per km^2, the required quality of service of a macrocell user can be maintained via the proper selection of independent or cooperative learning and appropriate Markov state models.

READ FULL TEXT
research
03/18/2018

A Machine Learning Approach for Power Allocation in HetNets Considering QoS

There is an increase in usage of smaller cells or femtocells to improve ...
research
12/15/2022

Distributed-Training-and-Execution Multi-Agent Reinforcement Learning for Power Control in HetNet

In heterogeneous networks (HetNets), the overlap of small cells and the ...
research
05/20/2020

A reinforcement learning based decision support system in textile manufacturing process

This paper introduced a reinforcement learning based decision support sy...
research
08/31/2022

Transmit Power Control for Indoor Small Cells: A Method Based on Federated Reinforcement Learning

Setting the transmit power setting of 5G cells has been a long-term topi...
research
08/31/2023

Multi Agent DeepRL based Joint Power and Subchannel Allocation in IAB networks

Integrated Access and Backhauling (IAB) is a viable approach for meeting...
research
10/17/2021

A Q-Learning-based Approach for Distributed Beam Scheduling in mmWave Networks

We consider the problem of distributed downlink beam scheduling and powe...
research
02/28/2023

Ask and You Shall be Served: Representing and Solving Multi-agent Optimization Problems with Service Requesters and Providers

In scenarios with numerous emergencies that arise and require the assist...

Please sign up or login with your details

Forgot password? Click here to reset