Multi-Agent Deep Reinforcement Learning Based Resource Management in SWIPT Enabled Cellular Networks with H2H/M2M Co-Existence

12/29/2022
by   Xuehua Li, et al.
0

Machine-to-Machine (M2M) communication is crucial in developing Internet of Things (IoT). As it is well known that cellular networks have been considered as the primary infrastructure for M2M communications, there are several key issues to be addressed in order to deploy M2M communications over cellular networks. Notably, the rapid growth of M2M traffic dramatically increases energy consumption, as well as degrades the performance of existing Human-to-Human (H2H) traffic. Sustainable operation technology and resource management are efficacious ways for solving these issues. In this paper, we investigate a resource management problem in cellular networks with H2H/M2M coexistence. First, considering the energy-constrained nature of machine type communication devices (MTCDs), we propose a novel network model enabled by simultaneous wireless information and power transfer (SWIPT), which empowers MTCDs with the ability to simultaneously perform energy harvesting (EH) and information decoding. Given the diverse characteristics of IoT devices, we subdivide MTCDs into critical and tolerable types, further formulating the resource management problem as an energy efficiency (EE) maximization problem under divers Quality-of-Service (QoS) constraints. Then, we develop a multi-agent deep reinforcement learning (DRL) based scheme to solve this problem. It provides optimal spectrum, transmit power and power splitting (PS) ratio allocation policies, along with efficient model training under designed behaviour-tracking based state space and common reward function. Finally, we verify that with a reasonable training mechanism, multiple M2M agents successfully work cooperatively in a distributed way, resulting in network performance that outperforms other intelligence approaches in terms of convergence speed and meeting the EE and QoS requirements.

READ FULL TEXT

page 1

page 13

page 14

research
01/19/2018

Energy-Efficient SWIPT in IoT Distributed Antenna Systems

The rapid growth of Internet of Things (IoT) dramatically increases powe...
research
11/22/2021

Multi-agent Bayesian Deep Reinforcement Learning for Microgrid Energy Management under Communication Failures

Microgrids (MGs) are important players for the future transactive energy...
research
09/06/2021

LoRa-RL: Deep Reinforcement Learning for Resource Management in Hybrid Energy LoRa Wireless Networks

LoRa wireless networks are considered as a key enabling technology for n...
research
08/26/2023

Cooperative Resource Trading for Network Slicing in Industrial IoT: A Multi-Agent DRL Approach

The industrial Internet of Things (IIoT) and network slicing (NS) paradi...
research
06/12/2020

Using Reinforcement Learning to Allocate and Manage Service Function Chains in Cellular Networks

It is expected that the next generation cellular networks provide a conn...
research
09/17/2021

Deep Reinforcement Learning Based Multidimensional Resource Management for Energy Harvesting Cognitive NOMA Communications

The combination of energy harvesting (EH), cognitive radio (CR), and non...
research
03/24/2020

Joint Optimization of Spectrum and Energy Efficiency Considering the C-V2X Security: A Deep Reinforcement Learning Approach

Cellular vehicle-to-everything (C-V2X) communication, as a part of 5G wi...

Please sign up or login with your details

Forgot password? Click here to reset