Size-based scheduling vs fairness for datacenter flows: a queuing perspective

03/24/2022
by   James Roberts, et al.
0

Contrary to the conclusions of a recent body of work where approximate shortest remaining processing time first (SRPT) flow scheduling is advocated for datacenter networks, this paper aims to demonstrate that per-flow fairness remains a preferable objective. We evaluate abstract queuing models by analysis and simulation to illustrate the non-optimality of SRPT under the reasonable assumptions that datacenter flows occur in batches and bursts and not, as usually assumed, individually at the instants of a Poisson process. Results for these models have significant implications for the design of bandwidth sharing strategies for datacenter networks. In particular, we propose a novel "virtual fair scheduling" algorithm that enforces fairness between batches and is arguably simple enough to be implemented in high speed devices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/22/2020

To schedule or not to schedule: when no-scheduling can beat the best-known flow scheduling algorithm in datacenter networks

Conventional wisdom for minimizing the average flow completion time (AFC...
research
12/29/2021

Online Starvation Mitigation to Balance Average Flow Time and Fairness

In job scheduling, it is well known that Shortest Remaining Processing T...
research
01/17/2020

A New Fairness Model based on User's Objective for Multi-user Multi-processor Online Scheduling

Resources of a multi-user system in multi-processor online scheduling ar...
research
02/02/2021

Low-Rate Overuse Flow Tracer (LOFT): An Efficient and Scalable Algorithm for Detecting Overuse Flows

Current probabilistic flow-size monitoring can only detect heavy hitters...
research
11/29/2019

Algorithms for flows over time with scheduling costs

Flows over time have received substantial attention from both an optimiz...
research
06/26/2020

QCluster: Clustering Packets for FlowScheduling

Flow scheduling is crucial in data centers, as it directly influences us...
research
08/25/2021

A Case for Sampling Based Learning Techniques in Coflow Scheduling

Coflow scheduling improves data-intensive application performance by imp...

Please sign up or login with your details

Forgot password? Click here to reset