Learning to Harness Bandwidth with Multipath Congestion Control and Scheduling

05/29/2021
by   Shiva Raj Pokhrel, et al.
0

Multipath TCP (MPTCP) has emerged as a facilitator for harnessing and pooling available bandwidth in wireless/wireline communication networks and in data centers. Existing implementations of MPTCP such as, Linked Increase Algorithm (LIA), Opportunistic LIA (OLIA) and BAlanced LInked Adaptation (BALIA) include separate algorithms for congestion control and packet scheduling, with pre-selected control parameters. We propose a Deep Q-Learning (DQL) based framework for joint congestion control and packet scheduling for MPTCP. At the heart of the solution is an intelligent agent for interface, learning and actuation, which learns from experience optimal congestion control and scheduling mechanism using DQL techniques with policy gradients. We provide a rigorous stability analysis of system dynamics which provides important practical design insights. In addition, the proposed DQL-MPTCP algorithm utilizes the `recurrent neural network' and integrates it with `long short-term memory' for continuously i) learning dynamic behavior of subflows (paths) and ii) responding promptly to their behavior using prioritized experience replay. With extensive emulations, we show that the proposed DQL-based MPTCP algorithm outperforms MPTCP LIA, OLIA and BALIA algorithms. Moreover, the DQL-MPTCP algorithm is robust to time-varying network characteristics, and provides dynamic exploration and exploitation of paths.

READ FULL TEXT
research
04/09/2019

Passive TCP Identification for Wired and WirelessNetworks: A Long-Short Term Memory Approach

Transmission control protocol (TCP) congestion control is one of the key...
research
02/15/2020

Leveraging Coupled BBR and Adaptive Packet Scheduling to Boost MPTCP

Quite a few algorithms have been proposed to optimize the transmission p...
research
02/09/2022

Optimal Congestion Control for Time-varying Wireless Links

Modern networks exhibit a high degree of variability in link rates. Cell...
research
09/30/2021

MCS Adaptation within the Cellular V2X Sidelink

Adaptation of the Modulation and Coding Scheme (MCS) within the Cellular...
research
01/11/2022

Congestion Control Mechanisms for Inter-Datacenter Networks

Applications running in geographically distributed setting are becoming ...
research
08/09/2020

User Popularity-based Packet Scheduling for Congestion Control in Ad-hoc Social Networks

Traditional ad-hoc network packet scheduling schemes cannot fulfill the ...
research
04/07/2021

Optimal CPU Scheduling in Data Centers via a Finite-Time Distributed Quantized Coordination Mechanism

In this paper we analyze the problem of optimal task scheduling for data...

Please sign up or login with your details

Forgot password? Click here to reset