Carrier-Sense Multiple Access for Heterogeneous Wireless Networks Using Deep Reinforcement Learning

10/16/2018
by   Yiding Yu, et al.
0

This paper investigates a new class of carrier-sense multiple access (CSMA) protocols that employ deep reinforcement learning (DRL) techniques for heterogeneous wireless networking, referred to as carrier-sense deep-reinforcement learning multiple access (CS-DLMA). Existing CSMA protocols, such as the medium access control (MAC) of WiFi, are designed for a homogeneous network environment in which all nodes adopt the same protocol. Such protocols suffer from severe performance degradation in a heterogeneous environment where there are nodes adopting other MAC protocols. This paper shows that DRL techniques can be used to design efficient MAC protocols for heterogeneous networking. In particular, in a heterogeneous environment with nodes adopting different MAC protocols (e.g., CS-DLMA, TDMA, and ALOHA), a CS-DLMA node can learn to maximize the sum throughput of all nodes. Furthermore, compared with WiFi's CSMA, CS-DLMA can achieve both higher sum throughput and individual throughputs when coexisting with other MAC protocols. Last but not least, a salient feature of CS-DLMA is that it does not need to know the operating mechanisms of the co-existing MACs. Neither does it need to know the number of nodes using these other MACs.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
10/11/2019

Non-Uniform Time-Step Deep Q-Network for Carrier-Sense Multiple Access in Heterogeneous Wireless Networks

This paper investigates a new class of carrier-sense multiple access (CS...
research
12/01/2017

Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks

This paper investigates the use of deep reinforcement learning (DRL) in ...
research
03/25/2020

Multi-Agent Deep Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks with Imperfect Channels

This paper investigates a futuristic spectrum sharing paradigm for heter...
research
04/27/2022

Online Distributed Evolutionary Optimization of Time Division Multiple Access Protocols

With the advent of cheap, miniaturized electronics, ubiquitous networkin...
research
09/02/2020

Towards A Learning-Based Framework for Self-Driving Design of Networking Protocols

Networking protocols are designed through long-time and hard-work human ...
research
09/18/2023

Self-Sustaining Multiple Access with Continual Deep Reinforcement Learning for Dynamic Metaverse Applications

The Metaverse is a new paradigm that aims to create a virtual environmen...
research
08/09/2021

A Self-Configurable Grouping Method for Integrated Wi-SUN FAN and TSCH-based Networks

Recent applications in large-scale wireless mesh networks (WSN), e.g., A...

Please sign up or login with your details

Forgot password? Click here to reset