MSDF: A Deep Reinforcement Learning Framework for Service Function Chain Migration

11/12/2019
by   Ruoyun Chen, et al.
0

Under dynamic traffic, service function chain (SFC) migration is considered as an effective way to improve resource utilization. However, the lack of future network information leads to non-optimal solutions, which motivates us to study reinforcement learning based SFC migration from a long-term perspective. In this paper, we formulate the SFC migration problem as a minimization problem with the objective of total network operation cost under constraints of users' quality of service. We firstly design a deep Q-network based algorithm to solve single SFC migration problem, which can adjust migration strategy online without knowing future information. Further, a novel multi-agent cooperative framework, called MSDF, is proposed to address the challenge of considering multiple SFC migration on the basis of single SFC migration. MSDF reduces the complexity thus accelerates the convergence speed, especially in large scale networks. Experimental results demonstrate that MSDF outperforms typical heuristic algorithms under various scenarios.

READ FULL TEXT
research
01/27/2022

A Deep Reinforcement Learning Approach for Service Migration in MEC-enabled Vehicular Networks

Multi-access edge computing (MEC) is a key enabler to reduce the latency...
research
11/17/2021

CAMIG: Concurrency-Aware Live Migration Management of Multiple Virtual Machines in SDN-enabled Clouds

By integrating Software-Defined Networking and cloud computing, virtuali...
research
02/20/2020

E2E Migration Strategies Towards 5G: Long-term Migration Plan and Evolution Roadmap

After freezing the first phase of the fifth generation of wireless netwo...
research
06/24/2022

Multi-Agent Deep Reinforcement Learning for Cost- and Delay-Sensitive Virtual Network Function Placement and Routing

This paper proposes an effective and novel multiagent deep reinforcement...
research
03/27/2020

Rational Agent-Based Decision Algorithm for Strategic Converged Network Migration Planning

To keep up with constantly growing user demands for services with higher...
research
09/10/2023

Learning-based Incentive Mechanism for Task Freshness-aware Vehicular Twin Migration

Vehicular metaverses are an emerging paradigm that integrates extended r...
research
10/23/2013

Predictable Migration and Communication in the Quest-V Multikernel

Quest-V is a system we have been developing from the ground up, with obj...

Please sign up or login with your details

Forgot password? Click here to reset