Self-play Learning Strategies for Resource Assignment in Open-RAN Networks

03/03/2021
by   Xiaoyang Wang, et al.
0

Open Radio Access Network (ORAN) is being developed with an aim to democratise access and lower the cost of future mobile data networks, supporting network services with various QoS requirements, such as massive IoT and URLLC. In ORAN, network functionality is dis-aggregated into remote units (RUs), distributed units (DUs) and central units (CUs), which allows flexible software on Commercial-Off-The-Shelf (COTS) deployments. Furthermore, the mapping of variable RU requirements to local mobile edge computing centres for future centralized processing would significantly reduce the power consumption in cellular networks. In this paper, we study the RU-DU resource assignment problem in an ORAN system, modelled as a 2D bin packing problem. A deep reinforcement learning-based self-play approach is proposed to achieve efficient RU-DU resource management, with AlphaGo Zero inspired neural Monte-Carlo Tree Search (MCTS). Experiments on representative 2D bin packing environment and real sites data show that the self-play learning strategy achieves intelligent RU-DU resource assignment for different network conditions.

READ FULL TEXT

page 8

page 10

research
03/18/2021

Deep Reinforcement Learning-Aided RAN Slicing Enforcement for B5G Latency Sensitive Services

The combination of cloud computing capabilities at the network edge and ...
research
09/15/2018

Deep Reinforcement Learning Based Mode Selection and Resource Management for Green Fog Radio Access Networks

Fog radio access networks (F-RANs) are seen as potential architectures t...
research
04/05/2020

Multi-agent Reinforcement Learning for Resource Allocation in IoT networks with Edge Computing

To support popular Internet of Things (IoT) applications such as virtual...
research
08/23/2022

DRL-based Distributed Resource Allocation for Edge Computing in Cell-Free Massive MIMO Network

In this paper, with the aim of addressing the stringent computing and qu...
research
12/22/2022

Energy-Efficient Baseband Function Deployments for Service-Oriented Open RAN

Recently open radio access network (Open RAN), which splits baseband fun...
research
02/27/2019

Accelerating Self-Play Learning in Go

By introducing several new Go-specific and non-Go-specific techniques al...
research
11/14/2019

A guide through the open-box system: Room and Proctor Intelligent Decider for large scale tests programming RaPID-OMEGA

We present the documentation and mathematical modeling of the open-box s...

Please sign up or login with your details

Forgot password? Click here to reset