DeepPR: Incremental Recovery for Interdependent VNFs with Deep Reinforcement Learning

by   Genya Ishigaki, et al.

The increasing reliance upon cloud services entails more flexible networks that are realized by virtualized network equipment and functions. When such advanced network systems face a massive failure by natural disasters or attacks, the recovery of the entire systems may be conducted in a progressive way due to limited repair resources. The prioritization of network equipment in the recovery phase influences the interim computation and communication capability of systems, since the systems are operated under partial functionality. Hence, finding the best recovery order is a critical problem, which is further complicated by virtualization due to dependency among network nodes and layers. This paper deals with a progressive recovery problem under limited resources in networks with VNFs, where some dependent network layers exist. We prove the NP-hardness of the progressive recovery problem and approach the optimum solution by introducing DeepPR, a progressive recovery technique based on deep reinforcement learning. Our simulation results indicate that DeepPR can obtain 98.4 The results suggest the applicability of Deep RL to more general progressive recovery problems and similar intractable resource allocation problems.


Communication and Computation O-RAN Resource Slicing for URLLC Services Using Deep Reinforcement Learning

The evolution of the future beyond-5G/6G networks towards a service-awar...

DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing

Network slicing enables multiple virtual networks run on the same physic...

Modelling resource allocation in uncertain system environment through deep reinforcement learning

Reinforcement Learning has applications in field of mechatronics, roboti...

Neural-Progressive Hedging: Enforcing Constraints in Reinforcement Learning with Stochastic Programming

We propose a framework, called neural-progressive hedging (NP), that lev...

Decision Automation for Electric Power Network Recovery

Critical infrastructure systems such as electric power networks, water n...

Scaling Serverless Functions in Edge Networks: A Reinforcement Learning Approach

With rapid advances in containerization techniques, the serverless compu...

Holographic Image Sensing

Holographic representations of data enable distributed storage with prog...

Please sign up or login with your details

Forgot password? Click here to reset