Efficient Approximation Algorithms for Scheduling Coflows with Precedence Constraints in Identical Parallel Networks to Minimize Weighted Completion Time

07/09/2023
by   Chi-Yeh Chen, et al.
0

This paper focuses on the problem of coflow scheduling with precedence constraints in identical parallel networks, which is a well-known 𝒩𝒫-hard problem. Coflow is a relatively new network abstraction used to characterize communication patterns in data centers. Both flow-level scheduling and coflow-level scheduling problems are examined, with the key distinction being the scheduling granularity. The proposed algorithm effectively determines the scheduling order of coflows by employing the primal-dual method. When considering workload sizes and weights that are dependent on the network topology in the input instances, our proposed algorithm for the flow-level scheduling problem achieves an approximation ratio of O(χ) where χ is the coflow number of the longest path in the directed acyclic graph (DAG). Additionally, when taking into account workload sizes that are topology-dependent, the algorithm achieves an approximation ratio of O(Rχ), where R represents the ratio of maximum weight to minimum weight. For the coflow-level scheduling problem, the proposed algorithm achieves an approximation ratio of O(mχ), where m is the number of network cores, when considering workload sizes and weights that are topology-dependent. Moreover, when considering workload sizes that are topology-dependent, the algorithm achieves an approximation ratio of O(Rmχ). In the coflows of multi-stage job scheduling problem, the proposed algorithm achieves an approximation ratio of O(χ). Although our theoretical results are based on a limited set of input instances, experimental findings show that the results for general input instances outperform the theoretical results, thereby demonstrating the effectiveness and practicality of the proposed algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2022

Scheduling Coflows with Precedence Constraints for Minimizing the Total Weighted Completion Time in Identical Parallel Networks

Coflow is a recently proposed network abstraction for data-parallel comp...
research
06/04/2023

Efficient Approximation Algorithms for Scheduling Coflows with Total Weighted Completion Time in Identical Parallel Networks

This paper addresses the scheduling problem of coflows in identical para...
research
04/06/2022

Scheduling Coflows for Minimizing the Total Weighted Completion Time in Identical Parallel Networks

Coflow is a recently proposed network abstraction to capture communicati...
research
04/16/2022

Scheduling Coflows for Minimizing the Total Weighted Completion Time in Heterogeneous Parallel Networks

Coflow is a network abstraction used to represent communication patterns...
research
02/14/2023

Scheduling Coflows for Minimizing the Makespan in Identical Parallel Networks

With the development of technology, parallel computing applications have...
research
11/27/2017

On the Optimality of Scheduling Dependent MapReduce Tasks on Heterogeneous Machines

MapReduce is the most popular big-data computation framework, motivating...
research
11/16/2021

Self-encoding Barnacle Mating Optimizer Algorithm for Manpower Scheduling in Flow Shop

Flow Shop Scheduling (FSS) has been widely researched due to its applica...

Please sign up or login with your details

Forgot password? Click here to reset