Delay-Aware Scheduling over mmWave/Sub-6 Dual Interfaces: A Reinforcement Learning Approach

05/18/2020
by   Ying Cao, et al.
0

We consider a transmitter with mmWave/sub6 dual interfaces. Due to the intermittency of mmWave channel, the transmitter must schedule packets wisely across the interfaces to minimize the average delay by observing the system state. We usethe well-known dynamic programming methods and Q-learning to find the optimal scheduling policy and investigate the influenceof observing CSI on the optimal policy under different levels of knowledge of the environment. We find that only when the channel state transition model is not available, the instantaneousCSI can help in reducing system delay

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/04/2019

Integrating Sub-6 GHz and Millimeter Wave to Combat Blockage: Delay-Optimal Scheduling

Millimeter wave (mmWave) technologies have the potential to achieve very...
research
09/28/2020

Delay Optimal Cross-Layer Scheduling Over Markov Channels with Power Constraint

We consider a scenario where a power constrained transmitter delivers ra...
research
07/26/2018

Joint Queue-Aware and Channel-Aware Delay Optimal Scheduling of Arbitrarily Bursty Traffic over Multi-State Time-Varying Channels

This paper is motivated by the observation that the average queueing del...
research
09/28/2022

Preempting to Minimize Age of Incorrect Information under Random Delay

We consider the problem of optimizing the decision of a preemptive trans...
research
03/06/2022

Age of Incorrect Information under Delay

This paper investigates the problem of minimizing the Age of Incorrect I...
research
08/15/2023

The Role of Early Sampling in Age of Information Minimization in the Presence of ACK Delays

We study the structure of the optimal sampling policy to minimize the av...
research
08/04/2023

Robust cell-free mmWave/sub-THz access using minimal coordination and coarse synchronization

This study investigates simpler alternatives to coherent joint transmiss...

Please sign up or login with your details

Forgot password? Click here to reset