Fork-join and redundancy systems with heavy-tailed job sizes

05/28/2021
by   Youri Raaijmakers, et al.
0

We investigate the tail asymptotics of the response time distribution for the cancel-on-start (c.o.s.) and cancel-on-completion (c.o.c.) variants of redundancy-d scheduling and the fork-join model with heavy-tailed job sizes. We present bounds, which only differ in the pre-factor, for the tail probability of the response time in the case of the first-come first-served (FCFS) discipline. For the c.o.s. variant we restrict ourselves to redundancy-d scheduling, which is a special case of the fork-join model. In particular, for regularly varying job sizes with tail index -ν the tail index of the response time for the c.o.s. variant of redundancy-d equals -min{d_cap(ν-1),ν}, where d_cap = min{d,N-k}, N is the number of servers and k is the integer part of the load. This result indicates that for d_cap < ν/ν-1 the waiting time component is dominant, whereas for d_cap > ν/ν-1 the job size component is dominant. Thus, having d = ⌈min{ν/ν-1,N-k}⌉ replicas is sufficient to achieve the optimal asymptotic tail behavior of the response time. For the c.o.c. variant of the fork-join(n_F,n_J) model the tail index of the response time, under some assumptions on the load, equals 1-ν and 1-(n_F+1-n_J)ν, for identical and i.i.d. replicas, respectively; here the waiting time component is always dominant.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2021

When Does the Gittins Policy Have Asymptotically Optimal Response Time Tail?

We consider scheduling in the M/G/1 queue with unknown job sizes. It is ...
research
06/02/2021

Nudge: Stochastically Improving upon FCFS

The First-Come First-Served (FCFS) scheduling policy is the most popular...
research
11/04/2022

Optimal Scheduling in the Multiserver-job Model under Heavy Traffic

Multiserver-job systems, where jobs require concurrent service at many s...
research
04/21/2021

Stability and Optimization of Speculative Queueing Networks

We provide a queueing-theoretic framework for job replication schemes ba...
research
12/07/2020

Non-Asymptotic Performance Analysis of Size-Based Routing Policies

We investigate the performance of two size-based routing policies: the S...
research
04/26/2022

An Empirical Study of the Occurrence of Heavy-Tails in Training a ReLU Gate

A particular direction of recent advance about stochastic deep-learning ...
research
09/26/2021

WCFS: A new framework for analyzing multiserver systems

Multiserver queueing systems are found at the core of a wide variety of ...

Please sign up or login with your details

Forgot password? Click here to reset