Multi-Objective Congestion Control

07/03/2021
by   Yiqing Ma, et al.
0

Decades of research on Internet congestion control (CC) has produced a plethora of algorithms that optimize for different performance objectives. Applications face the challenge of choosing the most suitable algorithm based on their needs, and it takes tremendous efforts and expertise to customize CC algorithms when new demands emerge. In this paper, we explore a basic question: can we design a single CC algorithm to satisfy different objectives? We propose MOCC, the first multi-objective congestion control algorithm that attempts to address this challenge. The core of MOCC is a novel multi-objective reinforcement learning framework for CC that can automatically learn the correlations between different application requirements and the corresponding optimal control policies. Under this framework, MOCC further applies transfer learning to transfer the knowledge from past experience to new applications, quickly adapting itself to a new objective even if it is unforeseen. We provide both user-space and kernel-space implementation of MOCC. Real-world experiments and extensive simulations show that MOCC well supports multi-objective, competing or outperforming the best existing CC algorithms on individual objectives, and quickly adapting to new applications (e.g., 14.2x faster than prior work) without compromising old ones.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2020

Provable Multi-Objective Reinforcement Learning with Generative Models

Multi-objective reinforcement learning (MORL) is an extension of ordinar...
research
06/02/2021

Expected Scalarised Returns Dominance: A New Solution Concept for Multi-Objective Decision Making

In many real-world scenarios, the utility of a user is derived from the ...
research
07/19/2021

DeepCC: Bridging the Gap Between Congestion Control and Applications via Multi-Objective Optimization

The increasingly complicated and diverse applications have distinct netw...
research
03/02/2023

Reinforcement Learning Guided Multi-Objective Exam Paper Generation

To reduce the repetitive and complex work of instructors, exam paper gen...
research
10/14/2021

Multi-task problems are not multi-objective

Multi-objective optimization (MOO) aims at finding a set of optimal conf...
research
09/29/2020

Multi-objective Reinforcement Learning based approach for User-Centric Power Optimization in Smart Home Environments

Smart homes require every device inside them to be connected with each o...
research
08/28/2022

Learning to Optimize: Balancing Two Conflict Metrics in MB-HTS Networks

For multi-beam high throughput (MB-HTS) geostationary (GEO) satellite ne...

Please sign up or login with your details

Forgot password? Click here to reset