Deep Reinforcement Learning based Joint Spectrum Allocation and Configuration Design for STAR-RIS-Assisted V2X Communications

08/16/2023
by   Pyae Sone Aung, et al.
0

Vehicle-to-Everything (V2X) communications play a crucial role in ensuring safe and efficient modern transportation systems. However, challenges arise in scenarios with buildings, leading to signal obstruction and coverage limitations. To alleviate these challenges, reconfigurable intelligent surface (RIS) is regarded as an effective solution for communication performance by tuning passive signal reflection. RIS has acquired prominence in 6G networks due to its improved spectral efficiency, simple deployment, and cost-effectiveness. Nevertheless, conventional RIS solutions have coverage limitations. Therefore, researchers have started focusing on the promising concept of simultaneously transmitting and reflecting RIS (STAR-RIS), which provides 360coverage while utilizing the advantages of RIS technology. In this paper, a STAR-RIS-assisted V2X communication system is investigated. An optimization problem is formulated to maximize the achievable data rate for vehicle-to-infrastructure (V2I) users while satisfying the latency and reliability requirements of vehicle-to-vehicle (V2V) pairs by jointly optimizing the spectrum allocation, amplitudes, and phase shifts of STAR-RIS elements, digital beamforming vectors for V2I links, and transmit power for V2V pairs. Since it is challenging to solve in polynomial time, we decompose our problem into two sub-problems. For the first sub-problem, we model the control variables as a Markov Decision Process (MDP) and propose a combined double deep Q-network (DDQN) with an attention mechanism so that the model can potentially focus on relevant inputs. For the latter, a standard optimization-based approach is implemented to provide a real-time solution, reducing computational costs. Extensive numerical analysis is developed to demonstrate the superiority of our proposed algorithm compared to benchmark schemes.

READ FULL TEXT

page 1

page 3

page 8

page 10

research
09/08/2022

Joint Optimization of STAR-RIS Assisted UAV Communication Systems

In this letter, we study the simultaneously transmitting and reflecting ...
research
09/18/2022

Resource Allocation of STAR-RIS Assisted Full-Duplex Systems

Well-designed simultaneously transmitting and reflecting RIS (STAR-RIS),...
research
12/13/2021

Max-Min Energy-Efficiency Fair Optimization in STAR-RIS Assisted System

In this paper, we investigate simultaneously transmitting and reflecting...
research
08/11/2023

Joint Beamforming Optimization for Active STAR-RIS Assisted ISAC systems

In this paper, we investigate an active simultaneously transmitting and ...
research
05/06/2023

Simultaneously Transmitting and Reflecting RIS (STAR-RIS) Assisted Multi-Antenna Covert Communications: Analysis and Optimization

This paper investigates the multi-antenna covert communications assisted...
research
12/02/2022

Simultaneous Transmitting and Reflecting-Reconfigurable Intelligent Surface in 6G: Design Guidelines and Future Perspectives

Reconfigurable intelligent surfaces (RISs) have been considered as a pro...
research
07/13/2021

Transfer Learning in Multi-Agent Reinforcement Learning with Double Q-Networks for Distributed Resource Sharing in V2X Communication

This paper addresses the problem of decentralized spectrum sharing in ve...

Please sign up or login with your details

Forgot password? Click here to reset