Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided mmWave MIMO Systems

05/18/2022
by   Wangyang Xu, et al.
8

Reconfigurable intelligent surface (RIS) has recently gained popularity as a promising solution for improving the signal transmission quality of wireless communications with less hardware cost and energy consumption. This letter offers a novel deep reinforcement learning (DRL) algorithm based on a location-aware imitation environment for the joint beamforming design in an RIS-aided mmWave multiple-input multiple-output system. Specifically, we design a neural network to imitate the transmission environment based on the geometric relationship between the user's location and the mmWave channel. Following this, a novel DRL-based method is developed that interacts with the imitation environment using the easily available location information. Finally, simulation results demonstrate that the proposed DRL-based algorithm provides more robust performance without excessive interaction overhead compared to the existing DRL-based approaches.

READ FULL TEXT

page 1

page 2

page 3

page 6

page 8

page 11

page 12

page 13

research
02/24/2020

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Recently, the reconfigurable intelligent surface (RIS), benefited from t...
research
02/22/2020

Vehicle Tracking in Wireless Sensor Networks via Deep Reinforcement Learning

Vehicle tracking has become one of the key applications of wireless sens...
research
07/31/2019

PrecoderNet: Hybrid Beamforming for Millimeter Wave Systems Using Deep Reinforcement Learning

Millimeter wave (mmWave) with large-scale antenna arrays is a promising ...
research
08/16/2022

Deep Reinforcement Learning for RIS-aided Multiuser Full-Duplex Secure Communications with Hardware Impairments

In this paper, we investigate a reconfigurable intelligent surface (RIS)...
research
06/14/2019

Self-Tuning Sectorization: Deep Reinforcement Learning Meets Broadcast Beam Optimization

Beamforming in multiple input multiple output (MIMO) systems is one of t...
research
02/16/2022

Deep Contextual Bandits for Orchestrating Multi-User MISO Systems with Multiple RISs

The emergent technology of Reconfigurable Intelligent Surfaces (RISs) ha...
research
08/20/2023

Deep Reinforcement Learning for Artificial Upwelling Energy Management

The potential of artificial upwelling (AU) as a means of lifting nutrien...

Please sign up or login with your details

Forgot password? Click here to reset