DeepAI AI Chat
Log In Sign Up

Resource Allocation in Multicore Elastic Optical Networks: A Deep Reinforcement Learning Approach

07/05/2022
by   Juan Pinto-Ríos, et al.
Pontificia Universidad Católica de Valparaíso
0

A deep reinforcement learning approach is applied, for the first time, to solve the routing, modulation, spectrum and core allocation (RMSCA) problem in dynamic multicore fiber elastic optical networks (MCF-EONs). To do so, a new environment - compatible with OpenAI's Gym - was designed and implemented to emulate the operation of MCF-EONs. The new environment processes the agent actions (selection of route, core and spectrum slot) by considering the network state and physical-layer-related aspects. The latter includes the available modulation formats and their reach and the inter-core crosstalk (XT), an MCF-related impairment. If the resulting quality of the signal is acceptable, the environment allocates the resources selected by the agent. After processing the agent's action, the environment is configured to give the agent a numerical reward and information about the new network state. The blocking performance of four different agents was compared through simulation to 3 baseline heuristics used in MCF-EONs. Results obtained for the NSFNet and COST239 network topologies show that the best-performing agent achieves, on average, up to a four-times decrease in blocking probability concerning the best-performing baseline heuristic methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/10/2020

Dynamic Multi-Modulation Allocation Scheme for Elastic Optical Networks

In order to deal with the recent rapid increase in Internet traffic, a t...
05/27/2022

Deep Reinforcement Learning for Distributed and Uncoordinated Cognitive Radios Resource Allocation

This paper presents a novel deep reinforcement learning-based resource a...
05/12/2020

α-Fair Resource Allocation in Optical Networks under Tidal Traffic

We propose a game-theoretic α-fair routing and spectrum allocation (RSA)...
08/24/2020

Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent Deep Reinforcement Learning

Dynamic dispatching is one of the core problems for operation optimizati...
05/12/2020

Fair Resource Allocation in Optical Networks under Tidal Traffic

We propose a game-theoretic alpha-fair routing and spectrum allocation (...