DeepAI AI Chat
Log In Sign Up

Enhanced Pub/Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning

by   Carlos E. Arruda, et al.
Université d'Évry Val d'Essonne

Sensors are being extensively deployed and are expected to expand at significant rates in the coming years. They typically generate a large volume of data on the internet of things (IoT) application areas like smart cities, intelligent traffic systems, smart grid, and e-health. Cloud, edge and fog computing are potential and competitive strategies for collecting, processing, and distributing IoT data. However, cloud, edge, and fog-based solutions need to tackle the distribution of a high volume of IoT data efficiently through constrained and limited resource network infrastructures. This paper addresses the issue of conveying a massive volume of IoT data through a network with limited communications resources (bandwidth) using a cognitive communications resource allocation based on Reinforcement Learning (RL) with SARSA algorithm. The proposed network infrastructure (PSIoTRL) uses a Publish/ Subscribe architecture to access massive and highly distributed IoT data. It is demonstrated that the PSIoTRL bandwidth allocation for buffer flushing based on SARSA enhances the IoT aggregator buffer occupation and network link utilization. The PSIoTRL dynamically adapts the IoT aggregator traffic flushing according to the Pub/Sub topic's priority and network constraint requirements.


page 1

page 2

page 3

page 4


A Publish/Subscribe QoS-aware Framework for Massive IoT Traffic Orchestration

Internet of Things (IoT) application deployment requires the allocation ...

Enhanced Hybrid Automatic Repeat Request Scheduling for Non-Terrestrial IoT Networks

Non-terrestrial networks (NTNs) complement their terrestrial counterpart...

A Resource Allocation Scheme for Energy Demand Management in 6G-enabled Smart Grid

Smart grid (SG) systems enhance grid resilience and efficient operation,...

Resilient Execution of Data-triggered Applications on Edge, Fog and Cloud Resources

Internet of Things (IoT) is leading to the pervasive availability of str...

Fog-Based Detection for Random-Access IoT Networks with Per-Measurement Preambles

Internet of Things (IoT) systems may be deployed to monitor spatially di...