Enhancing WiFi Multiple Access Performance with Federated Deep Reinforcement Learning

02/13/2021

∙

Carrier sensing multiple access/collision avoidance (CSMA/CA) is the backbone MAC protocol for IEEE 802.11 networks. However, tuning the binary exponential back-off (BEB) mechanism of CSMA/CA in user-dense scenarios so as to maximize aggregate throughput still remains a practically essential and challenging problem. In this paper, we propose a new and enhanced multiple access mechanism based on the application of deep reinforcement learning (DRL) and Federated learning (FL). A new Monte Carlo (MC) reward updating method for DRL training is proposed and the access history of each station is used to derive a DRL-based MAC protocol that improves the network throughput vis-a-vis the traditional distributed coordination function (DCF). Further, federated learning (FL) is applied to achieve fairness among users. The simulation results showcase that the proposed federated reinforcement multiple access (FRMA) performs better than basic DCF by 20 request-to-send/clear-to-send (RTS/CTS) by 5 in user-dense scenarios.

READ FULL TEXT

Enhancing WiFi Multiple Access Performance with Federated Deep Reinforcement Learning

Federated Learning over a Wireless Network: Distributed User Selection through Random Access

Traffic Differentiation in Dense WLANs with CSMA/ECA-DR MAC Protocol

Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach

Personalized Federated Deep Reinforcement Learning-based Trajectory Optimization for Multi-UAV Assisted Edge Computing

Non-Uniform Time-Step Deep Q-Network for Carrier-Sense Multiple Access in Heterogeneous Wireless Networks

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

Learning-based Autonomous Channel Access in the Presence of Hidden Terminals

Enhancing WiFi Multiple Access Performance with Federated Deep Reinforcement Learning

Related Research

Federated Learning over a Wireless Network: Distributed User Selection through Random Access

Traffic Differentiation in Dense WLANs with CSMA/ECA-DR MAC Protocol

Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach

Personalized Federated Deep Reinforcement Learning-based Trajectory Optimization for Multi-UAV Assisted Edge Computing

Non-Uniform Time-Step Deep Q-Network for Carrier-Sense Multiple Access in Heterogeneous Wireless Networks

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

Learning-based Autonomous Channel Access in the Presence of Hidden Terminals