The Power of d Choices in Scheduling for Data Centers with Heterogeneous Servers

03/31/2019
by   Amir Moaddeli, et al.
0

MapReduce framework is the de facto in big data and its applications where a big data-set is split into small data chunks that are replicated on different servers among thousands of servers. The heterogeneous server structure of the system makes the scheduling much harder than scheduling for systems with homogeneous servers. Throughput optimality of the system on one hand and delay optimality on the other hand creates a dilemma for assigning tasks to servers. The JSQ-MaxWeight and Balanced-Pandas algorithms are the states of the arts algorithms with theoretical guarantees on throughput and delay optimality for systems with two and three levels of data locality. However, the scheduling complexity of these two algorithms are way too much. Hence, we use the power of d choices algorithm combined with the Balanced-Pandas algorithm and the JSQ-MaxWeight algorithm, and compare the complexity of the simple algorithms and the power of d choices versions of them. We will further show that the Balanced-Pandas algorithm combined with the power of the d choices, Balanced-Pandas-Pod, not only performs better than simple Balanced-Pandas, but also is less sensitive to the parameter d than the combination of the JSQ-MaxWeight algorithm and the power of the d choices, JSQ-MaxWeight-Pod. In fact in our extensive simulation results, the Balanced-Pandas-Pod algorithm is performing better than the simple Balanced-Pandas algorithm in low and medium loads, where data centers are usually performing at, and performs almost the same as the Balanced-Pandas algorithm at high loads. Note that the load balancing complexity of Balanced-Pandas and JSQ-MaxWeight algorithms are O(M), where M is the number of servers in the system which is in the order of thousands servers, whereas the complexity of Balanced-Pandas-Pod and JSQ-MaxWeight-Pod are O(1), that makes the central scheduler faster and saves energy.

READ FULL TEXT
research
09/23/2017

GB-PANDAS: Throughput and heavy-traffic optimality analysis for affinity scheduling

Dynamic affinity scheduling has been an open problem for nearly three de...
research
04/14/2020

Comparisons of Algorithms in Big Data Processing

Parallel computing is the fundamental base for MapReduce framework in Ha...
research
05/09/2017

Affinity Scheduling and the Applications on Data Center Scheduling with Data Locality

MapReduce framework is the de facto standard in Hadoop. Considering the ...
research
11/30/2021

Popcorns-Pro: A Cooperative Network-Server Approach for Data Center Energy Optimization

Data centers have become a popular computing platform for various applic...
research
01/13/2019

Blind GB-PANDAS: A Blind Throughput-Optimal Load Balancing Algorithm for Affinity Scheduling

Dynamic affinity load balancing of multi-type tasks on multi-skilled ser...
research
09/02/2021

Load Balancing in Heterogeneous Server Clusters: Insights From a Product-Form Queueing Model

Efficiently exploiting servers in data centers requires performance anal...
research
12/16/2016

Optimizing Stochastic Scheduling in Fork-Join Queueing Models: Bounds and Applications

Fork-Join (FJ) queueing models capture the dynamics of system paralleliz...

Please sign up or login with your details

Forgot password? Click here to reset