Log In Sign Up

HyLine: a Simple and Practical Flow Scheduling for Commodity Datacenters

by   Soheil Abbasloo, et al.

Today's datacenter networks (DCNs) have been built upon multipath topologies where each path contains multiple links. However, flow scheduling schemes proposed to minimize flow completion times (FCT) in DCNs are based on algorithms which are optimum or close-to-optimum only over single link. Moreover, most of these scheduling schemes seek either fully centralized approaches having overhead of communicating to a central entity or fully distributed approaches requiring changes in the fabric. Motivated by these shortcomings, we present HyLine a simple scheduling design for commodity DCNs which is equipped with a joint load-balancing and flow scheduling (path-aware) design exploiting the multipath nature of DCNs. HyLine takes a hybrid approach and uses the global-awareness of centralized and agility of distributed techniques without requiring any changes in the fabric. To that end, it determines a threshold margin identifying flows for which using centralized approach is beneficial. We have shown through extensive ns2 simulations that despite HyLine's simplicity, it significantly outperforms existing schemes and achieves lower average and 99th percentile FCTs. For instance, compared to Qjump-state-of-the-art practical scheme-and pFabric-one of the best performing flow scheduling schemes-HyLine reduces average FCT up to 68 respectively, under a production datacenter workload.


page 1

page 2

page 3

page 4


LightFDG: An Integrated Approach to Flow Detection and Grooming in Optical Wireless DCNs

LightFDG is an integrated approach to flow detection (FD) and flow groom...

Stochastic Non-preemptive Co-flow Scheduling with Time-Indexed Relaxation

Co-flows model a modern scheduling setting that is commonly found in a v...

Scheduling Opportunistic Links in Two-Tiered Reconfigurable Datacenters

Reconfigurable optical topologies are emerging as a promising technology...

RepFlow: Minimizing Flow Completion Times with Replicated Flows in Data Centers

Short TCP flows that are critical for many interactive applications in d...

Saath: Speeding up CoFlows by Exploiting the Spatial Dimension

Coflow scheduling improves data-intensive application performance by imp...

DCoflow: Deadline-Aware Scheduling Algorithm for Coflows in Datacenter Networks

Datacenter networks routinely support the data transfers of distributed ...