Reinforcement Learning on Computational Resource Allocation of Cloud-based Wireless Networks

10/10/2020
by   Beiran Chen, et al.
16

Wireless networks used for Internet of Things (IoT) are expected to largely involve cloud-based computing and processing. Softwarised and centralised signal processing and network switching in the cloud enables flexible network control and management. In a cloud environment, dynamic computational resource allocation is essential to save energy while maintaining the performance of the processes. The stochastic features of the Central Processing Unit (CPU) load variation as well as the possible complex parallelisation situations of the cloud processes makes the dynamic resource allocation an interesting research challenge. This paper models this dynamic computational resource allocation problem into a Markov Decision Process (MDP) and designs a model-based reinforcement-learning agent to optimise the dynamic resource allocation of the CPU usage. Value iteration method is used for the reinforcement-learning agent to pick up the optimal policy during the MDP. To evaluate our performance we analyse two types of processes that can be used in the cloud-based IoT networks with different levels of parallelisation capabilities, i.e., Software-Defined Radio (SDR) and Software-Defined Networking (SDN). The results show that our agent rapidly converges to the optimal policy, stably performs in different parameter settings, outperforms or at least equally performs compared to a baseline algorithm in energy savings for different scenarios.

READ FULL TEXT
research
09/27/2017

A Simple Reinforcement Learning Mechanism for Resource Allocation in LTE-A Networks with Markov Decision Process and Q-Learning

Resource allocation is still a difficult issue to deal with in wireless ...
research
01/31/2021

A SDN/OpenFlow Framework for Dynamic Resource Allocation based on Bandwidth Allocation Model

The communication network context in actual systems like 5G, cloud and I...
research
10/29/2019

Resource Allocation Using Gradient Boosting Aided Deep Q-Network for IoT in C-RANs

In this paper, we investigate dynamic resource allocation (DRA) problems...
research
10/12/2011

Resource Allocation Among Agents with MDP-Induced Preferences

Allocating scarce resources among agents to maximize global utility is, ...
research
10/19/2020

Deep Reinforcement Learning for Adaptive Network Slicing in 5G for Intelligent Vehicular Systems and Smart Cities

Intelligent vehicular systems and smart city applications are the fastes...
research
01/13/2018

Queue-aware Energy Efficient Control for Dense Wireless Networks

We consider the problem of long term power allocation in dense wireless ...
research
05/27/2018

Reinforcement-Learning-Based Resource Allocation in Fog Radio Access Networks for Various IoT Environments

Fog radio access network (F-RAN) has been recently proposed to satisfy t...

Please sign up or login with your details

Forgot password? Click here to reset