Extendable NFV-Integrated Control Method Using Reinforcement Learning

12/19/2019
by   Akito Suzuki, et al.
0

Network functions virtualization (NFV) enables telecommunications service providers to realize various network services by flexibly combining multiple virtual network functions (VNFs). To provide such services, an NFV control method should optimally allocate such VNFs into physical networks and servers by taking account of the combination(s) of objective functions and constraints for each metric defined for each VNF type, e.g., VNF placements and routes between the VNFs. The NFV control method should also be extendable for adding new metrics or changing the combination of metrics. One approach for NFV control to optimize allocations is to construct an algorithm that simultaneously solves the combined optimization problem. However, this approach is not extendable because the problem needs to be reformulated every time a new metric is added or a combination of metrics is changed. Another approach involves using an extendable network-control architecture that coordinates multiple control algorithms specified for individual metrics. However, to the best of our knowledge, no method has been developed that can optimize allocations through this kind of coordination. In this paper, we propose an extendable NFV-integrated control method by coordinating multiple control algorithms. We also propose an efficient coordination algorithm based on reinforcement learning. Finally, we evaluate the effectiveness of the proposed method through simulations.

READ FULL TEXT

page 10

page 13

research
02/03/2022

Dynamic Virtual Network Embedding Algorithm based on Graph Convolution Neural Network and Reinforcement Learning

Network virtualization (NV) is a technology with broad application prosp...
research
10/10/2022

Supervisory Coordination of Robotic Fiber Positioners in Multi-Object Spectrographs

In this paper, we solve the complete coordination problem of robotic fib...
research
12/20/2020

Reinforcement Learning-based Product Delivery Frequency Control

Frequency control is an important problem in modern recommender systems....
research
09/30/2021

Coordinated Reinforcement Learning for Optimizing Mobile Networks

Mobile networks are composed of many base stations and for each of them ...
research
10/06/2021

From STL Rulebooks to Rewards

The automatic synthesis of neural-network controllers for autonomous age...
research
10/02/2019

Synthesis of Orchestrations and Choreographies: Bridging the Gap between Supervisory Control and Coordination of Services

We present a number of contributions to bridging the gap between supervi...
research
06/20/2023

Reinforcement Learning-based Virtual Fixtures for Teleoperation of Hydraulic Construction Machine

The utilization of teleoperation is a crucial aspect of the construction...

Please sign up or login with your details

Forgot password? Click here to reset