Optimal and Low-Complexity Dynamic Spectrum Access for RF-Powered Ambient Backscatter System with Online Reinforcement Learning

09/08/2018
by   Nguyen Van Huynh, et al.
0

Ambient backscatter has been introduced with a wide range of applications for low power wireless communications. In this article, we propose an optimal and low-complexity dynamic spectrum access framework for RF-powered ambient backscatter system. In this system, the secondary transmitter not only harvests energy from ambient signals (from incumbent users), but also backscatters these signals to its receiver for data transmission. Under the dynamics of the ambient signals, we first adopt the Markov decision process (MDP) framework to obtain the optimal policy for the secondary transmitter, aiming to maximize the system throughput. However, the MDP-based optimization requires complete knowledge of environment parameters, e.g., the probability of a channel to be idle and the probability of a successful packet transmission, that may not be practical to obtain. To cope with such incomplete knowledge of the environment, we develop a low-complexity online reinforcement learning algorithm that allows the secondary transmitter to "learn" from its decisions and then attain the optimal policy. Simulation results show that the proposed learning algorithm not only efficiently deals with the dynamics of the environment, but also improves the average throughput up to 50 and delay up to 80

READ FULL TEXT
research
08/23/2018

Reinforcement Learning Approach for RF-Powered Cognitive Radio Network with Ambient Backscatter

For an RF-powered cognitive radio network with ambient backscattering ca...
research
10/03/2018

Deep Reinforcement Learning for Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks

In an RF-powered backscatter cognitive radio network, multiple secondary...
research
04/08/2019

"Jam Me If You Can": Defeating Jammer with Deep Dueling Neural Network Architecture and Ambient Backscattering Augmented Communications

With conventional anti-jamming solutions like frequency hopping or sprea...
research
02/25/2019

Optimal Online Transmission Policy for Energy-Constrained Wireless-Powered Communication Networks

This work considers the design of online transmission policy in a wirele...
research
05/13/2020

DeepFake: Deep Dueling-based Deception Strategy to Defeat Reactive Jammers

In this paper, we introduce DeepFake, a novel deep reinforcement learnin...
research
06/14/2017

Accelerated Reinforcement Learning Algorithms with Nonparametric Function Approximation for Opportunistic Spectrum Access

We study the problem of throughput maximization by predicting spectrum o...
research
04/12/2023

A Low-Complexity Post-Weighting Predistorter in a mMIMO Transmitter Under Crosstalk

In hybrid beamforming, the beam oriented digital predistortion (BO-DPD) ...

Please sign up or login with your details

Forgot password? Click here to reset