Delay-aware Resource Allocation in Fog-assisted IoT Networks Through Reinforcement Learning

by   Qiang Fan, et al.

Fog nodes in the vicinity of IoT devices are promising to provision low latency services by offloading tasks from IoT devices to them. Mobile IoT is composed by mobile IoT devices such as vehicles, wearable devices and smartphones. Owing to the time-varying channel conditions, traffic loads and computing loads, it is challenging to improve the quality of service (QoS) of mobile IoT devices. As task delay consists of both the transmission delay and computing delay, we investigate the resource allocation (i.e., including both radio resource and computation resource) in both the wireless channel and fog node to minimize the delay of all tasks while their QoS constraints are satisfied. We formulate the resource allocation problem into an integer non-linear problem, where both the radio resource and computation resource are taken into account. As IoT tasks are dynamic, the resource allocation for different tasks are coupled with each other and the future information is impractical to be obtained. Therefore, we design an on-line reinforcement learning algorithm to make the sub-optimal decision in real time based on the historical data. The performance of the designed algorithm has been demonstrated by extensive simulation results.


PORA: Predictive Offloading and Resource Allocation in Dynamic Fog Computing Systems

In multi-tiered fog computing systems, to accelerate the processing of c...

Joint Latency-Energy Minimization for Fog-Assisted Wireless IoT Networks

This work aims to present a joint resource allocation method for a fog-a...

Efficient C-RAN Random Access for IoT Devices: Learning Links via Recommendation Systems

We focus on C-RAN random access protocols for IoT devices that yield low...

Reinforcement-Learning-Based Resource Allocation in Fog Radio Access Networks for Various IoT Environments

Fog radio access network (F-RAN) has been recently proposed to satisfy t...

Accuracy-Guaranteed Collaborative DNN Inference in Industrial IoT via Deep Reinforcement Learning

Collaboration among industrial Internet of Things (IoT) devices and edge...

Managing Consensus-Based Cooperative Task Allocation for IIoT Networks

Current IoT services include industry-oriented services, which often req...

Please sign up or login with your details

Forgot password? Click here to reset