Symbolic Reinforcement Learning for Safe RAN Control

03/11/2021
by   Alexandros Nikou, et al.
0

In this paper, we demonstrate a Symbolic Reinforcement Learning (SRL) architecture for safe control in Radio Access Network (RAN) applications. In our automated tool, a user can select a high-level safety specifications expressed in Linear Temporal Logic (LTL) to shield an RL agent running in a given cellular network with aim of optimizing network performance, as measured through certain Key Performance Indicators (KPIs). In the proposed architecture, network safety shielding is ensured through model-checking techniques over combined discrete system models (automata) that are abstracted through reinforcement learning. We demonstrate the user interface (UI) helping the user set intent specifications to the architecture and inspect the difference in allowed and blocked actions.

READ FULL TEXT

page 1

page 2

page 3

research
06/03/2021

Safe RAN control: A Symbolic Reinforcement Learning Approach

In this paper, we present a Symbolic Reinforcement Learning (SRL) based ...
research
08/11/2023

Safeguarding Learning-based Control for Smart Energy Systems with Sampling Specifications

We study challenges using reinforcement learning in controlling energy s...
research
12/12/2022

Verifiably Safe Reinforcement Learning with Probabilistic Guarantees via Temporal Logic

Reinforcement Learning (RL) can solve complex tasks but does not intrins...
research
07/06/2023

Intent-driven Intelligent Control and Orchestration in O-RAN Via Hierarchical Reinforcement Learning

rApps and xApps need to be controlled and orchestrated well in the open ...
research
12/02/2020

Safe Reinforcement Learning for Antenna Tilt Optimisation using Shielding and Multiple Baselines

Safe interaction with the environment is one of the most challenging asp...
research
08/29/2017

Safe Reinforcement Learning via Shielding

Reinforcement learning algorithms discover policies that maximize reward...
research
02/24/2021

Deep Reinforcement Learning for Safe Landing Site Selection with Concurrent Consideration of Divert Maneuvers

This research proposes a new integrated framework for identifying safe l...

Please sign up or login with your details

Forgot password? Click here to reset