Deep Reinforcement Learning for Practical Phase Shift Optimization in RIS-aided MISO URLLC Systems

by   Ramin Hashemi, et al.

Reconfigurable intelligent surfaces (RISs) can assist the wireless systems in providing reliable and low-latency links to realize the requirements in Industry 4.0. In this paper, the practical phase shift optimization in a RIS-aided ultra-reliable and low-latency communication (URLLC) system at a factory setting is performed by applying a novel deep reinforcement learning (DRL) algorithm named as twin-delayed deep deterministic policy gradient (TD3). First, the system achievable rate in finite blocklength (FBL) regime is identified for each actuator then, the problem is formulated where the objective is to maximize the total achievable FBL rate, subject to non-linear amplitude response and the phase shift values constraint. Since the amplitude response equality constraint is highly non-convex and non-linear, we employ the TD3 to tackle the problem. The considered method relies on interacting RIS with industrial scenario by taking actions which are the phase shifts at the RIS elements, to maximize the total FBL rate. We assess the performance loss of the system when the RIS is non-ideal, i.e., non-linear amplitude response with/without phase quantization and compare it with ideal RIS. The numerical results show that optimizing phase shifts in non-ideal RIS via the considered TD3 method is highly beneficial to improve the performance.


page 1

page 2

page 3

page 4


Intelligent Reflecting Surface: Practical Phase Shift Model and Beamforming Optimization

Intelligent reflecting surface (IRS) that enables the control of the wir...

Average Rate and Error Probability Analysis in Short Packet Communications over RIS-aided URLLC Systems

In this paper, the average achievable rate and error probability of a re...

Average Rate Analysis of RIS-aided Short Packet Communication in URLLC Systems

In this paper, the average achievable rate of a re-configurable intellig...

Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach

An active reconfigurable intelligent surface (RIS)-aided multi-user down...

A DRL-based Reflection Enhancement Method for RIS-assisted Multi-receiver Communications

In reconfigurable intelligent surface (RIS)-assisted wireless communicat...

Please sign up or login with your details

Forgot password? Click here to reset