Adversarial Reinforcement Learning-based Robust Access Point Coordination Against Uncoordinated Interference

04/02/2020
by   Yuto Kihira, et al.
0

This paper proposes a robust adversarial reinforcement learning (RARL)-based multi-access point (AP) coordination method that is robust even against unexpected decentralized operations of uncoordinated APs. Multi-AP coordination is a promising technique towards IEEE 802.11be, and there are studies that use RL for multi-AP coordination. Indeed, a simple RL-based multi-AP coordination method diminishes the collision probability among the APs; therefore, the method is a promising approach to improve time-resource efficiency. However, this method is vulnerable to frame transmissions of uncoordinated APs that are less aware of frame transmissions of other coordinated APs. To help the central agent experience even such unexpected frame transmissions, in addition to the central agent, the proposed method also competitively trains an adversarial AP that disturbs coordinated APs by causing frame collisions intensively. Besides, we propose to exploit a history of frame losses of a coordinated AP to promote reasonable competition between the central agent and adversarial AP. The simulation results indicate that the proposed method can avoid uncoordinated interference and thereby improve the minimum sum of the throughputs in the system compared to not considering the uncoordinated AP.

READ FULL TEXT
research
05/08/2023

Multi-AP Coordinated Spatial Reuse for Wi-Fi 8: Group Creation and Scheduling

Multi-Access Point Coordination (MAPC) will be a key feature in next gen...
research
04/28/2021

Joint AP Association and PCS Threshold Selection in Dense Full-duplex Wireless Networks

Joint access point (AP) association and physical carrier sensing (PCS) t...
research
08/06/2019

Promoting Coordination through Policy Regularization in Multi-Agent Reinforcement Learning

A central challenge in multi-agent reinforcement learning is the inducti...
research
05/10/2021

Dynamic Multichannel Access via Multi-agent Reinforcement Learning: Throughput and Fairness Guarantees

We consider a multichannel random access system in which each user acces...
research
08/29/2023

An Advanced Tree Algorithm with Interference Cancellation in Uplink and Downlink

In this paper, we propose Advanced Tree-algorithm with Interference Canc...
research
03/09/2021

Learning to Play Soccer From Scratch: Sample-Efficient Emergent Coordination through Curriculum-Learning and Competition

This work proposes a scheme that allows learning complex multi-agent beh...
research
12/20/2018

Impact of LTE's Periodic Interference on Heterogeneous Wi-Fi Transmissions

The problem of Wi-Fi and LTE coexistence has been significantly debated ...

Please sign up or login with your details

Forgot password? Click here to reset