Distributional Reinforcement Learning for mmWave Communications with Intelligent Reflectors on a UAV

11/03/2020
by   Qianqian Zhang, et al.
0

In this paper, a novel communication framework that uses an unmanned aerial vehicle (UAV)-carried intelligent reflector (IR) is proposed to enhance multi-user downlink transmissions over millimeter wave (mmWave) frequencies. In order to maximize the downlink sum-rate, the optimal precoding matrix (at the base station) and reflection coefficient (at the IR) are jointly derived. Next, to address the uncertainty of mmWave channels and maintain line-of-sight links in a real-time manner, a distributional reinforcement learning approach, based on quantile regression optimization, is proposed to learn the propagation environment of mmWave communications, and, then, optimize the location of the UAV-IR so as to maximize the long-term downlink communication capacity. Simulation results show that the proposed learning-based deployment of the UAV-IR yields a significant advantage, compared to a non-learning UAV-IR, a static IR, and a direct transmission schemes, in terms of the average data rate and the achievable line-of-sight probability of downlink mmWave communications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2019

Reflections in the Sky: Millimeter Wave Communication with UAV-Carried Intelligent Reflectors

In this paper, a novel approach that uses an unmanned aerial vehicle (UA...
research
02/24/2020

Millimeter Wave Communications with an Intelligent Reflector: Performance Optimization and Distributional Reinforcement Learning

In this paper, a novel framework is proposed to optimize the downlink mu...
research
02/02/2021

Distributed Conditional Generative Adversarial Networks (GANs) for Data-Driven Millimeter Wave Communications in UAV Networks

In this paper, a novel framework is proposed to perform data-driven air-...
research
02/22/2021

Distributed Generative Adversarial Networks for mmWaveChannel Modeling in Wireless UAV Networks

In this paper, a novel framework is proposed to enable air-to-ground cha...
research
01/05/2019

A Unified Spatial Framework for UAV-aided MmWave Networks

In this paper, we propose a unified three-dimensional (3D) spatial frame...
research
11/04/2019

Aerial Access and Backhaul in mmWave B5G Systems: Performance Dynamics and Optimization

The use of unmanned aerial vehicle (UAV)-based communication in millimet...
research
05/10/2018

Exploiting Location Information to Enhance Throughput in Downlink V2I Systems

Vehicle-to-Infrastructure (V2I) technology, combined with millimeter wav...

Please sign up or login with your details

Forgot password? Click here to reset