DeepAI AI Chat
Log In Sign Up

Beam Management in Ultra-dense mmWave Network via Federated Reinforcement Learning: An Intelligent and Secure Approach

10/04/2022
by   Qing Xue, et al.
Chongqing University of Post and Telecommunications
University of Glasgow
Southwest Jiaotong University
University of Electronic Science and Technology of China
um.edu.mo
0

Deploying ultra-dense networks that operate on millimeter wave (mmWave) band is a promising way to address the tremendous growth on mobile data traffic. However, one key challenge of ultra-dense mmWave network (UDmmN) is beam management due to the high propagation delay, limited beam coverage as well as numerous beams and users. In this paper, a novel systematic beam control scheme is presented to tackle the beam management problem which is difficult due to the nonconvex objective function. We employ double deep Q-network (DDQN) under a federated learning (FL) framework to address the above optimization problem, and thereby fulfilling adaptive and intelligent beam management in UDmmN. In the proposed beam management scheme based on FL (BMFL), the non-rawdata aggregation can theoretically protect user privacy while reducing handoff cost. Moreover, we propose to adopt a data cleaning technique in the local model training for BMFL, with the aim to further strengthen the privacy protection of users while improving the learning convergence speed. Simulation results demonstrate the performance gain of our proposed scheme.

READ FULL TEXT

page 1

page 5

page 6

page 9

page 11

03/08/2021

Radio Resource and Beam Management in 5G mmWave Using Clustering and Deep Reinforcement Learning

To optimally cover users in millimeter-Wave (mmWave) networks, clusterin...
07/09/2021

A Dual-Connection based Handover Scheme for Ultra-Dense Millimeter-Wave Cellular Networks

Mobile users in an ultra-dense millimeter-wave cellular network experien...
07/06/2021

GBLinks: GNN-Based Beam Selection and Link Activation for Ultra-dense D2D mmWave Networks

In this paper, we consider the problem of joint beam selection and link ...
02/01/2021

mmWall: A Reconfigurable Metamaterial Surface for mmWave Networks

To support faster and more efficient networks, mobile operators and serv...
05/11/2018

Standalone and Non-Standalone Beam Management for 3GPP NR at mmWaves

The next generation of cellular networks will exploit mmWave frequencies...
03/31/2021

Cooperative Beam Hopping for Accurate Positioning in Ultra-Dense LEO Satellite Networks

In ultra-dense LEO satellite networks, conventional communication-orient...