Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems

08/26/2022
by   Yu Zhang, et al.
0

Cell-free massive multiple-input-multiple-output is promising to meet the stringent quality-of-experience (QoE) requirements of railway wireless communications by coordinating many successional access points (APs) to serve the onboard users coherently. A key challenge is how to deliver the desired contents timely due to the radical changing propagation environment caused by the growing train speed. In this paper, we propose to proactively cache the likely-requesting contents at the upcoming APs which perform the coherent transmission to reduce end-to-end delay. A long-term QoE-maximization problem is formulated and two cache placement algorithms are proposed. One is based on heuristic convex optimization (HCO) and the other exploits deep reinforcement learning (DRL) with soft actor-critic (SAC). Compared to the conventional benchmark, numerical results show the advantage of our proposed algorithms on QoE and hit probability. With the advanced DRL model, SAC outperforms HCO on QoE by predicting the user requests accurately.

READ FULL TEXT

page 1

page 3

research
01/22/2022

A Collaborative Statistical Actor-Critic Learning Approach for 6G Network Slicing Control

Artificial intelligence (AI)-driven zero-touch massive network slicing i...
research
07/20/2020

Energy-Efficient Non-Orthogonal Multicast and Unicast Transmission of Cell-Free Massive MIMO Systems with SWIPT

This work investigates the energy-efficient resource allocation for laye...
research
03/17/2021

Self-Organizing mmWave MIMO Cell-Free Networks With Hybrid Beamforming: A Hierarchical DRL-Based Design

In a cell-free wireless network, distributed access points (APs) jointly...
research
04/19/2018

Mixed Quality of Service in Cell-Free Massive MIMO

Cell-free massive multiple-input multiple-output (MIMO) is a potential k...
research
03/14/2018

Enhancing Favorable Propagation in Cell-Free Massive MIMO Through Spatial User Grouping

Cell-Free (CF) Massive multiple-input multiple-output(MIMO) is a distrib...
research
02/15/2022

Efficient Content Delivery in Cache-Enabled VEN with Deadline-Constrained Heterogeneous Demands: A User-Centric Approach

Modern connected vehicles (CVs) frequently require diverse types of cont...

Please sign up or login with your details

Forgot password? Click here to reset