LoRa-RL: Deep Reinforcement Learning for Resource Management in Hybrid Energy LoRa Wireless Networks

09/06/2021
by   Rami Hamdi, et al.
0

LoRa wireless networks are considered as a key enabling technology for next generation internet of things (IoT) systems. New IoT deployments (e.g., smart city scenarios) can have thousands of devices per square kilometer leading to huge amount of power consumption to provide connectivity. In this paper, we investigate green LoRa wireless networks powered by a hybrid of the grid and renewable energy sources, which can benefit from harvested energy while dealing with the intermittent supply. This paper proposes resource management schemes of the limited number of channels and spreading factors (SFs) with the objective of improving the LoRa gateway energy efficiency. First, the problem of grid power consumption minimization while satisfying the system's quality of service demands is formulated. Specifically, both scenarios the uncorrelated and time-correlated channels are investigated. The optimal resource management problem is solved by decoupling the formulated problem into two sub-problems: channel and SF assignment problem and energy management problem. Since the optimal solution is obtained with high complexity, online resource management heuristic algorithms that minimize the grid energy consumption are proposed. Finally, taking into account the channel and energy correlation, adaptable resource management schemes based on Reinforcement Learning (RL), are developed. Simulations results show that the proposed resource management schemes offer efficient use of renewable energy in LoRa wireless networks.

READ FULL TEXT

page 1

page 13

page 14

page 15

page 17

research
05/03/2023

Optimal Resource Management for Hierarchical Federated Learning over HetNets with Wireless Energy Transfer

Remote monitoring systems analyze the environment dynamics in different ...
research
12/29/2022

Multi-Agent Deep Reinforcement Learning Based Resource Management in SWIPT Enabled Cellular Networks with H2H/M2M Co-Existence

Machine-to-Machine (M2M) communication is crucial in developing Internet...
research
01/13/2023

Hierarchical Deep Q-Learning Based Handover in Wireless Networks with Dual Connectivity

5G New Radio proposes the usage of frequencies above 10 GHz to speed up ...
research
09/29/2021

Signal power and energy-per-bit optimization problems in systems mMTC

Currently, the issues of the operation of the Internet of Things technol...
research
09/16/2022

Reinforcement Learning Based Cooperative P2P Energy Trading between DC Nanogrid Clusters with Wind and PV Energy Resources

In order to replace fossil fuels with the use of renewable energy resour...
research
04/09/2021

3D Wireless Channel Modeling for Multi-layer Network on Chip

The resource constraints and accuracy requirements for Internet of Thing...
research
12/22/2020

Intelligent Resource Allocation in Dense LoRa Networks using Deep Reinforcement Learning

The anticipated increase in the count of IoT devices in the coming years...

Please sign up or login with your details

Forgot password? Click here to reset