Medium Access using Distributed Reinforcement Learning for IoTs with Low-Complexity Wireless Transceivers

by   Hrishikesh Dutta, et al.

This paper proposes a distributed Reinforcement Learning (RL) based framework that can be used for synthesizing MAC layer wireless protocols in IoT networks with low-complexity wireless transceivers. The proposed framework does not rely on complex hardware capabilities such as carrier sensing and its associated algorithmic complexities that are often not supported in wireless transceivers of low-cost and low-energy IoT devices. In this framework, the access protocols are first formulated as Markov Decision Processes (MDP) and then solved using RL. A distributed and multi-Agent RL framework is used as the basis for protocol synthesis. Distributed behavior makes the nodes independently learn optimal transmission strategies without having to rely on full network level information and direct knowledge of behavior of other nodes. The nodes learn to minimize packet collisions such that optimal throughput can be attained and maintained for loading conditions that are higher than what the known benchmark protocols (such as ALOHA) for IoT devices without complex transceivers. In addition, the nodes are observed to be able to learn to act optimally in the presence of heterogeneous loading and network topological conditions. Finally, the proposed learning approach allows the wireless bandwidth to be fairly distributed among network nodes in a way that is not dependent on such heterogeneities. Via simulation experiments, the paper demonstrates the performance of the learning paradigm and its abilities to make nodes adapt their optimal transmission strategies on the fly in response to various network dynamics.



page 1

page 4


Towards Multi-agent Reinforcement Learning for Wireless Network Protocol Synthesis

This paper proposes a multi-agent reinforcement learning based medium ac...

Internet of things: a multiprotocol gateway as solution of the interoperability problem

One of the main challenges of the Internet of Things is the interoperabi...

RL-IoT: Reinforcement Learning to Interact with IoT Devices

Our life is getting filled by Internet of Things (IoT) devices. These de...

Design and Implementation of a Multiprotocol IoT Gateway

In the coming years, the interconnection of a large number of devices is...

Carrier-Sense Multiple Access for Heterogeneous Wireless Networks Using Deep Reinforcement Learning

This paper investigates a new class of carrier-sense multiple access (CS...

The Emergence of Wireless MAC Protocols with Multi-Agent Reinforcement Learning

In this paper, we propose a new framework, exploiting the multi-agent de...

Network Coding Based Evolutionary Network Formation for Dynamic Wireless Networks

In this paper, we aim to find a robust network formation strategy that c...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.