No Delay: Latency-Driven, Application Performance-Aware, Cluster Scheduling

by   Diana Andreea Popescu, et al.

Given the network latency variability observed in data centers, applications' performance is also determined by their placement within the data centre. We present NoMora, a cluster scheduling architecture whose core is represented by a latency-driven, application performance-aware, cluster scheduling policy. The policy places the tasks of an application taking into account the expected performance based on the measured network latency between pairs of hosts in the data center. Furthermore, if a tenant's application experiences increased network latency, and thus lower application performance, their application may be migrated to a better placement. Preliminary results show that our policy improves the overall average application performance by up to 13.4 to 42 factor of 1.79x and the median algorithm runtime by 1.16x compared to a random policy on the Google cluster workload. This demonstrates that application performance can be improved by exploiting the relationship between network latency and application performance, and the current network conditions in a data center, while preserving the demands of low-latency cluster scheduling.



There are no comments yet.


page 1

page 2

page 3

page 4


Archipelago: A Scalable Low-Latency Serverless Platform

The increased use of micro-services to build web applications has spurre...

Scheduling Low Latency Traffic for Wireless Control Systems in 5G Networks

We consider the problem of allocating 5G radio resources over wireless c...

Distributed and Application-aware Task Scheduling in Edge-clouds

Edge computing is an emerging technology which places computing at the e...

Reducing Tail Latency via Safe and Simple Duplication

Duplication can be a powerful strategy for overcoming stragglers in clou...

A Case for Data Centre Traffic Management on Software Programmable Ethernet Switches

Virtualisation first and cloud computing later has led to a consolidatio...

Low Delay Scheduling of Objects Over Multiple Wireless Paths

In this paper we consider the task of scheduling packet transmissions am...

An Adaptive Performance-oriented Scheduler for Static and Dynamic Heterogeneity

With the emergence of heterogeneous hardware paving the way for the post...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.