RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning

06/24/2021

∙

5G is regarded as a revolutionary mobile network, which is expected to satisfy a vast number of novel services, ranging from remote health care to smart cities. However, heterogeneous Quality of Service (QoS) requirements of different services and limited spectrum make the radio resource allocation a challenging problem in 5G. In this paper, we propose a multi-agent reinforcement learning (MARL) method for radio resource slicing in 5G. We model each slice as an intelligent agent that competes for limited radio resources, and the correlated Q-learning is applied for inter-slice resource block (RB) allocation. The proposed correlated Q-learning based interslice RB allocation (COQRA) scheme is compared with Nash Q-learning (NQL), Latency-Reliability-Throughput Q-learning (LRTQ) methods, and the priority proportional fairness (PPF) algorithm. Our simulation results show that the proposed COQRA achieves 32.4 compared with LRTQ, and 5.8 Significantly higher throughput and lower packet drop rate (PDR) is observed in comparison to PPF.

READ FULL TEXT

RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning

Market-Based Model in CR-WSN: A Q-Probabilistic Multi-agent Learning Approach

Inter-Cell Slicing Resource Partitioning via Coordinated Multi-Agent Deep Reinforcement Learning

Learning from Peers: Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G Network Slicing

Multi-Agent Reinforcement Learning for Network Selection and Resource Allocation in Heterogeneous multi-RAT Networks

PSACCF: Prioritized Online Slice Admission Control Considering Fairness in 5G/B5G Networks

Dynamic SDN-based Radio Access Network Slicing with Deep Reinforcement Learning for URLLC and eMBB Services

Multi-agent Reinforcement Learning for Dynamic Resource Management in 6G in-X Subnetworks

RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning

Related Research

Market-Based Model in CR-WSN: A Q-Probabilistic Multi-agent Learning Approach

Inter-Cell Slicing Resource Partitioning via Coordinated Multi-Agent Deep Reinforcement Learning

Learning from Peers: Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G Network Slicing

Multi-Agent Reinforcement Learning for Network Selection and Resource Allocation in Heterogeneous multi-RAT Networks

PSACCF: Prioritized Online Slice Admission Control Considering Fairness in 5G/B5G Networks

Dynamic SDN-based Radio Access Network Slicing with Deep Reinforcement Learning for URLLC and eMBB Services

Multi-agent Reinforcement Learning for Dynamic Resource Management in 6G in-X Subnetworks