A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access

08/20/2019
by   Chen Zhong, et al.
48

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple users attempt to access channels simultaneously. We employ the proposed framework as a single agent in the single-user case, and extend it to a decentralized multi-agent framework in the multi-user scenario. In both cases, we develop algorithms for the actor-critic deep reinforcement learning and evaluate the proposed learning policies via experiments and numerical results. In the single-user model, in order to evaluate the performance of the proposed channel access policy and the framework's tolerance against uncertainty, we explore different channel switching patterns and different switching probabilities. In the case of multiple users, we analyze the probabilities of each user accessing channels with favorable channel conditions and the probability of collision. We also address a time-varying environment to identify the adaptive ability of the proposed framework. Additionally, we provide comparisons (in terms of both the average reward and time efficiency) between the proposed actor-critic deep reinforcement learning framework, Deep-Q network (DQN) based approach, random access, and the optimal policy when the channel dynamics are known.

READ FULL TEXT

page 6

page 7

page 8

page 13

page 14

page 19

page 21

page 22

research
10/08/2018

Actor-Critic Deep Reinforcement Learning for Dynamic Multichannel Access

We consider the dynamic multichannel access problem, which can be formul...
research
08/28/2019

Deep Actor-Critic Reinforcement Learning for Anomaly Detection

Anomaly detection is widely applied in a variety of domains, involving f...
research
03/05/2023

Sparsity-Aware Intelligent Massive Random Access Control in Open RAN: A Reinforcement Learning Based Approach

Massive random access of devices in the emerging Open Radio Access Netwo...
research
08/05/2021

Ensemble Consensus-based Representation Deep Reinforcement Learning for Hybrid FSO/RF Communication Systems

Hybrid FSO/RF system requires an efficient FSO and RF link switching mec...
research
03/17/2022

GAC: A Deep Reinforcement Learning Model Toward User Incentivization in Unknown Social Networks

In recent years, providing incentives to human users for attracting thei...
research
12/27/2019

Crowdfunding Dynamics Tracking: A Reinforcement Learning Approach

Recent years have witnessed the increasing interests in research of crow...
research
11/13/2020

Scaffolding Reflection in Reinforcement Learning Framework for Confinement Escape Problem

This paper formulates an application of reinforcement learning for an ev...

Please sign up or login with your details

Forgot password? Click here to reset