Weighted Scheduling of Time-Sensitive Coflows

by   Olivier Brun, et al.

Datacenter networks routinely support the data transfers of distributed computing frameworks in the form of coflows, i.e., sets of concurrent flows related to a common task. The vast majority of the literature has focused on the problem of scheduling coflows for completion time minimization, i.e., to maximize the average rate at which coflows are dispatched in the network fabric. However, many modern applications generate coflows dedicated to online services and mission-critical computing tasks which have to comply with specific completion deadlines. In this paper, we introduce πš†π™³π™²πš˜πšπš•πš˜πš , a new algorithm to maximize the weighted number of coflows that complete before their deadline. By combining a dynamic programming algorithm along with parallel inequalities, our heuristic solution performs at once coflow admission control and coflow prioritization, imposing a Οƒ-order on the set of coflows. With extensive simulation, we demonstrate the effectiveness of our algorithm in improving up to 3Γ— more coflows that meet their deadline in comparison the best SotA solution, namely π™²πš‚-𝙼𝙷𝙰. Furthermore, when weights are used to differentiate coflow classes, πš†π™³π™²πš˜πšπš•πš˜πš  is able to improve the admission per class up to 4Γ—, while increasing the average weighted coflow admission rate.

βˆ™ 05/02/2022

DCoflow: Deadline-Aware Scheduling Algorithm for Coflows in Datacenter Networks

Datacenter networks routinely support the data transfers of distributed ...
βˆ™ 02/06/2018

Resilient Blocks for Summarising Distributed Data

Summarising distributed data is a central routine for parallel programmi...
βˆ™ 11/29/2019

Minimization of Weighted Completion Times in Path-based Coflow Scheduling

Coflow scheduling models communication requests in parallel computing fr...
βˆ™ 09/08/2015

A unified heuristic and an annotated bibliography for a large class of earliness-tardiness scheduling problems

This work proposes a unified heuristic algorithm for a large class of ea...
βˆ™ 04/09/2018

Prompt Scheduling for Selfish Agents

We give a prompt online mechanism for minimizing the sum of [weighted] c...
βˆ™ 01/03/2019

Coalition Game based Full-duplex Concurrent Scheduling in Millimeter Wave Wireless Backhaul Network

With the development of self-interference (SI) cancelation technology, f...
βˆ™ 05/25/2018

Multiview Learning of Weighted Majority Vote by Bregman Divergence Minimization

We tackle the issue of classifier combinations when observations have mu...

Please sign up or login with your details

Forgot password? Click here to reset