Deep Reinforcement Learning for Wireless Scheduling with Multiclass Services

11/27/2020
by   Apostolos Avranas, et al.
0

In this paper, we investigate the problem of scheduling and resource allocation over a time varying set of clients with heterogeneous demands.In this context, a service provider has to schedule traffic destined to users with different classes of requirements and to allocate bandwidth resources over time as a means to efficiently satisfy service demands within a limited time horizon. This is a highly intricate problem, in particular in wireless communication systems, and solutions may involve tools stemming from diverse fields, including combinatorics and constrained optimization. Although recent work has successfully proposed solutions based on Deep Reinforcement Learning (DRL), the challenging setting of heterogeneous user traffic and demands has not been addressed. We propose a deep deterministic policy gradient algorithm that combines state-of-the-art techniques, namely Distributional RL and Deep Sets, to train a model for heterogeneous traffic scheduling. We test on diverse scenarios with different time dependence dynamics, users' requirements, and resources available, demonstrating consistent results using both synthetic and real data. We evaluate the algorithm on a wireless communication setting using both synthetic and real data and show significant gains in terms of Quality of Service (QoS) defined by the classes, against state-of-the-art conventional algorithms from combinatorics, optimization and scheduling metric(e.g. Knapsack, Integer Linear Programming, Frank-Wolfe, Exponential Rule).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/11/2023

A Comparative Analysis of Deep Reinforcement Learning-based xApps in O-RAN

The highly heterogeneous ecosystem of Next Generation (NextG) wireless c...
research
08/08/2019

Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics

Efficient network slicing is vital to deal with the highly variable and ...
research
06/20/2020

Makespan minimization of Time-Triggered traffic on a TTEthernet network

The reliability of the increasing number of modern applications and syst...
research
05/15/2019

Deep reinforcement learning for scheduling in large-scale networked control systems

This work considers the problem of control and resource scheduling in ne...
research
05/22/2017

A Survey on QoE-oriented Wireless Resources Scheduling

Future wireless systems are expected to provide a wide range of services...
research
08/27/2021

Deep Reinforcement Learning for Wireless Resource Allocation Using Buffer State Information

As the number of user equipments (UEs) with various data rate and latenc...
research
08/30/2022

Effective Multi-User Delay-Constrained Scheduling with Deep Recurrent Reinforcement Learning

Multi-user delay constrained scheduling is important in many real-world ...

Please sign up or login with your details

Forgot password? Click here to reset