Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning

02/14/2020
by   Navid NaderiAlizadeh, et al.
0

We propose a mechanism for distributed radio resource management using multi-agent deep reinforcement learning (RL) for interference mitigation in wireless networks. We equip each transmitter in the network with a deep RL agent, which receives partial delayed observations from its associated users, while also exchanging observations with its neighboring agents, and decides on which user to serve and what transmit power to use at each scheduling interval. Our proposed framework enables the agents to make decisions simultaneously and in a distributed manner, without any knowledge about the concurrent decisions of other agents. Moreover, our design of the agents' observation and action spaces is scalable, in the sense that an agent trained on a scenario with a specific number of transmitters and receivers can be readily applied to scenarios with different numbers of transmitters and/or receivers. Simulation results demonstrate the superiority of our proposed approach compared to decentralized baselines in terms of the tradeoff between average and 5^th percentile user rates, while achieving performance close to, and even in certain cases outperforming, that of a centralized information-theoretic scheduling algorithm. We also show that our trained agents are robust and maintain their performance gains when experiencing mismatches between training and testing deployments.

READ FULL TEXT

page 23

page 24

page 26

research
06/20/2019

When Multiple Agents Learn to Schedule: A Distributed Radio Resource Management Framework

Interference among concurrent transmissions in a wireless network is a k...
research
03/07/2022

Reinforcement Learning for Location-Aware Scheduling

Recent techniques in dynamical scheduling and resource management have f...
research
05/13/2022

Distributed Transmission Control for Wireless Networks using Multi-Agent Reinforcement Learning

We examine the problem of transmission control, i.e., when to transmit, ...
research
05/21/2020

Distributed Resource Scheduling for Large-Scale MEC Systems: A Multi-Agent Ensemble Deep Reinforcement Learning with Imitation Acceleration

We consider the optimization of distributed resource scheduling to minim...
research
09/07/2021

On the impact of MDP design for Reinforcement Learning agents in Resource Management

The recent progress in Reinforcement Learning applications to Resource M...
research
05/10/2022

Multi-agent Reinforcement Learning for Dynamic Resource Management in 6G in-X Subnetworks

The 6G network enables a subnetwork-wide evolution, resulting in a "netw...
research
06/06/2022

Learning Generalized Wireless MAC Communication Protocols via Abstraction

To tackle the heterogeneous requirements of beyond 5G (B5G) and future 6...

Please sign up or login with your details

Forgot password? Click here to reset