Make TCP Great (again?!) in Cellular Networks: A Deep Reinforcement Learning Approach

12/26/2019
by   Soheil Abbasloo, et al.
0

Can we instead of designing just another new TCP, design a TCP plug-in which can boost the performance of the existing/future TCP designs in cellular networks? To answer this question, we introduce DeepCC plug-in. DeepCC leverages deep reinforcement learning (DRL), a modern decision-making tool, to steer TCP toward achieving applications' desired delay and high throughput in a highly dynamic network such as the cellular network. The fact that DeepCC does not try to reinvent/replace TCP but aims to boost the performance of it differentiates it from the most (if not all) of the existing reinforcement learning (RL) systems where RL systems are considered clean-slate alternative designs replacing the traditional ones. We used DeepCC plug-in to boost the performance of various old and new TCP schemes including TCP Cubic, Google's BBR, TCP Westwood, and TCP Illinois in cellular networks. Through both extensive trace-based evaluations and in-field tests, we show that not only DeepCC can significantly improve the performance of TCP, but also after accompanied by DeepCC, these schemes can outperform state-of-the-art TCP protocols including Aurora, Sprout, Verus, C2TCP, Copa, Indigo, Remy, PCC-Vivace, and LEDBAT in cellular networks.

READ FULL TEXT

page 4

page 17

research
10/29/2018

C2TCP: A Flexible Cellular TCP to Meet Stringent Delay Requirements

Since current widely available network protocols/systems are mainly thro...
research
07/07/2018

Cellular Controlled Delay TCP (C2TCP)

Cellular networks have special characteristics including highly variable...
research
08/02/2019

Bounding Queue Delay in Cellular Networks to Support Ultra-Low Latency Applications

Most of the current active queue management (AQM) designs have major iss...
research
03/03/2020

Can Increasing Input Dimensionality Improve Deep Reinforcement Learning?

Deep reinforcement learning (RL) algorithms have recently achieved remar...
research
07/10/2017

Deep Q-Learning for Self-Organizing Networks Fault Management and Radio Performance Improvement

We propose an algorithm to automate fault management in an outdoor cellu...
research
12/17/2020

High-Throughput Synchronous Deep RL

Deep reinforcement learning (RL) is computationally demanding and requir...
research
03/15/2019

Online Antenna Tuning in Heterogeneous Cellular Networks with Deep Reinforcement Learning

We aim to jointly optimize the antenna tilt angle, and the vertical and ...

Please sign up or login with your details

Forgot password? Click here to reset