No-Pain No-Gain: DRL Assisted Optimization in Energy-Constrained CR-NOMA Networks

04/13/2021
by   Zhiguo Ding, et al.
0

This paper applies machine learning to optimize the transmission policy of cognitive radio inspired non-orthogonal multiple access (CR-NOMA) networks, where time-division multiple access (TDMA) is used to serve multiple primary users and an energy-constrained secondary user is admitted to the primary users' time slots via NOMA. During each time slot, the secondary user performs the two tasks: data transmission and energy harvesting based on the signals received from the primary users. The goal of the paper is to maximize the secondary user's long-term throughput, by optimizing its transmit power and the time-sharing coefficient for its two tasks. The long-term throughput maximization problem is challenging due to the need for making decisions that yield long-term gains but might result in short-term losses. For example, when in a given time slot, a primary user with large channel gains transmits, intuition suggests that the secondary user should not carry out data transmission due to the strong interference from the primary user but perform energy harvesting only, which results in zero data rate for this time slot but yields potential long-term benefits. In this paper, a deep reinforcement learning (DRL) approach is applied to emulate this intuition, where the deep deterministic policy gradient (DDPG) algorithm is employed together with convex optimization. Our simulation results demonstrate that the proposed DRL assisted NOMA transmission scheme can yield significant performance gains over two benchmark schemes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2018

Deep Reinforcement Learning for Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks

In an RF-powered backscatter cognitive radio network, multiple secondary...
research
07/04/2023

New Designs of Robust Uplink NOMA in Cognitive Radio Inspired Communications

This paper considers a cognitive radio inspired uplink communication sce...
research
05/05/2018

Optimal Harvest-or-Transmit Strategy for Energy Harvesting Underlay Cognitive Radio Network

An underlay cognitive radio network with energy harvesting is considered...
research
09/17/2021

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

The combination of energy harvesting (EH), cognitive radio (CR), and non...
research
08/30/2020

Joint Transmission in QoE-Driven Backhaul-Aware MC-NOMA Cognitive Radio Network

In this paper, we develop a resource allocation framework to optimize th...
research
04/11/2023

Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach

An active reconfigurable intelligent surface (RIS)-aided multi-user down...
research
06/22/2023

Sum-Rate Maximization of RSMA-based Aerial Communications with Energy Harvesting: A Reinforcement Learning Approach

In this letter, we investigate a joint power and beamforming design prob...

Please sign up or login with your details

Forgot password? Click here to reset