RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN

11/12/2021
by   Peizheng Li, et al.
14

Radio access network (RAN) technologies continue to witness massive growth, with Open RAN gaining the most recent momentum. In the O-RAN specifications, the RAN intelligent controller (RIC) serves as an automation host. This article introduces principles for machine learning (ML), in particular, reinforcement learning (RL) relevant for the O-RAN stack. Furthermore, we review state-of-the-art research in wireless networks and cast it onto the RAN framework and the hierarchy of the O-RAN architecture. We provide a taxonomy of the challenges faced by ML/RL models throughout the development life-cycle: from the system specification to production deployment (data acquisition, model design, testing and management, etc.). To address the challenges, we integrate a set of existing MLOps principles with unique characteristics when RL agents are considered. This paper discusses a systematic life-cycle model development, testing and validation pipeline, termed: RLOps. We discuss all fundamental parts of RLOps, which include: model specification, development and distillation, production environment serving, operations monitoring, safety/security and data engineering platform. Based on these principles, we propose the best practices for RLOps to achieve an automated and reproducible model development process.

READ FULL TEXT

page 1

page 10

page 16

research
06/08/2022

Sim2real for Reinforcement Learning Driven Next Generation Networks

The next generation of networks will actively embrace artificial intelli...
research
02/09/2023

Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective

With the upsurge of interest in artificial intelligence machine learning...
research
03/18/2021

Hidden Technical Debts for Fair Machine Learning in Financial Services

The recent advancements in machine learning (ML) have demonstrated the p...
research
09/26/2022

Actor-Critic Network for O-RAN Resource Allocation: xApp Design, Deployment, and Analysis

Open Radio Access Network (O-RAN) has introduced an emerging RAN archite...
research
05/08/2021

Chameleon: A Semi-AutoML framework targeting quick and scalable development and deployment of production-ready ML systems for SMEs

Developing, scaling, and deploying modern Machine Learning solutions rem...
research
05/04/2022

Machine Learning Operations (MLOps): Overview, Definition, and Architecture

The final goal of all industrial machine learning (ML) projects is to de...
research
07/06/2023

Towards a safe MLOps Process for the Continuous Development and Safety Assurance of ML-based Systems in the Railway Domain

Traditional automation technologies alone are not sufficient to enable d...

Please sign up or login with your details

Forgot password? Click here to reset