Scheduling Coflows with Precedence Constraints for Minimizing the Total Weighted Completion Time in Identical Parallel Networks

05/05/2022
by   Chi-Yeh Chen, et al.
0

Coflow is a recently proposed network abstraction for data-parallel computing applications. This paper considers scheduling coflows with precedence constraints in identical parallel networks, such as to minimize the total weighted completion time of coflows. The identical parallel network is an architecture based on multiple network cores running in parallel. In the divisible coflow scheduling problem, the proposed algorithm achieves (6-2/m)μ and (5-2/m)μ approximate ratios for arbitrary release time and zero release time, respectively, where m is the number of network cores and μ is the coflow number of the longest path in the precedence graph. In the indivisible coflow scheduling problem, the proposed algorithm achieves (7-2/m)μ and (6-2/m)μ approximate ratios for arbitrary release time and zero release time, respectively. In the single network core scheduling problem, we propose a 5μ-approximation algorithm with arbitrary release times, and a 4μ-approximation without release time. Moreover, the proposed algorithm can be modified to solve the coflows of multi-stage jobs scheduling problem. In multi-stage jobs, coflow is transferred between servers to enable starting of next stage. This means that there are precedence constraints between coflows of job. Our result represents an improvement upon the previous best approximation ratio of O(μ̃log(N)/ log(log(N))) where μ̃ is the maximum number of coflows in a job and N is the number of servers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2022

Scheduling Coflows for Minimizing the Total Weighted Completion Time in Identical Parallel Networks

Coflow is a recently proposed network abstraction to capture communicati...
research
12/21/2020

Scheduling Coflows with Dependency Graph

Applications in data-parallel computing typically consist of multiple st...
research
11/29/2019

Minimization of Weighted Completion Times in Path-based Coflow Scheduling

Coflow scheduling models communication requests in parallel computing fr...
research
02/14/2023

Scheduling Coflows for Minimizing the Makespan in Identical Parallel Networks

With the development of technology, parallel computing applications have...
research
03/02/2021

Single and Parallel Machine Scheduling with Variable Release Dates

In this paper we study a simple extension of the total weighted flowtime...
research
11/27/2017

On the Optimality of Scheduling Dependent MapReduce Tasks on Heterogeneous Machines

MapReduce is the most popular big-data computation framework, motivating...

Please sign up or login with your details

Forgot password? Click here to reset