Near-Optimal Scheduling in the Congested Clique

02/14/2021
βˆ™
by   Keren Censor-Hillel, et al.
βˆ™
0
βˆ™

This paper provides three nearly-optimal algorithms for scheduling t jobs in the 𝖒𝖫𝖨𝖰𝖴𝖀 model. First, we present a deterministic scheduling algorithm that runs in O(π–¦π—…π—ˆπ–»π–Ίπ—…π–’π—ˆπ—‡π—€π–Ύπ—Œπ—π—‚π—ˆπ—‡ + π–½π—‚π—…π–Ίπ—π—‚π—ˆπ—‡) rounds for jobs that are sufficiently efficient in terms of their memory. The π–½π—‚π—…π–Ίπ—π—‚π—ˆπ—‡ is the maximum round complexity of any of the given jobs, and the π–¦π—…π—ˆπ–»π–Ίπ—…π–’π—ˆπ—‡π—€π–Ύπ—Œπ—π—‚π—ˆπ—‡ is the total number of messages in all jobs divided by the per-round bandwidth of n^2 of the 𝖒𝖫𝖨𝖰𝖴𝖀 model. Both are inherent lower bounds for any scheduling algorithm. Then, we present a randomized scheduling algorithm which runs t jobs in O(π–¦π—…π—ˆπ–»π–Ίπ—…π–’π—ˆπ—‡π—€π–Ύπ—Œπ—π—‚π—ˆπ—‡ + π–½π—‚π—…π–Ίπ—π—‚π—ˆπ—‡Β·logn+t) rounds and only requires that inputs and outputs do not exceed O(nlog n) bits per node, which is met by, e.g., almost all graph problems. Lastly, we adjust the random-delay-based scheduling algorithm [Ghaffari, PODC'15] from the 𝖒𝖫𝖨𝖰𝖴𝖀 model and obtain an algorithm that schedules any t jobs in O(t / n + π–«π—ˆπ–Όπ–Ίπ—…π–’π—ˆπ—‡π—€π–Ύπ—Œπ—π—‚π—ˆπ—‡ + π–½π—‚π—…π–Ίπ—π—‚π—ˆπ—‡Β·logn) rounds, where the π–«π—ˆπ–Όπ–Ίπ—…π–’π—ˆπ—‡π—€π–Ύπ—Œπ—π—‚π—ˆπ—‡ relates to the congestion at a single node of the 𝖒𝖫𝖨𝖰𝖴𝖀. We compare this algorithm to the previous approaches and show their benefit. We schedule the set of jobs on-the-fly, without a priori knowledge of its parameters or the communication patterns of the jobs. In light of the inherent lower bounds, all of our algorithms are nearly-optimal. We exemplify the power of our algorithms by analyzing the message complexity of the state-of-the-art MIS protocol [Ghaffari, Gouleakis, Konrad, Mitrovic and Rubinfeld, PODC'18], and we show that we can solve t instances of MIS in O(t + loglogΞ”logn) rounds, that is, in O(1) amortized time, for tβ‰₯loglogΞ”logn.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
βˆ™ 03/16/2020

Scheduling Lower Bounds via AND Subset Sum

Given N instances (X_1,t_1),...,(X_N,t_N) of Subset Sum, the AND Subset ...
research
βˆ™ 05/28/2021

Learning to Schedule

This paper proposes a learning and scheduling algorithm to minimize the ...
research
βˆ™ 03/23/2022

Exact methods and lower bounds for the Oven Scheduling Problem

The Oven Scheduling Problem (OSP) is a new parallel batch scheduling pro...
research
βˆ™ 08/03/2021

Deterministic Distributed Algorithms and Lower Bounds in the Hybrid Model

The model was recently introduced by Augustine et al. <cit.> in order t...
research
βˆ™ 03/06/2019

Softpressure: A Schedule-Driven Backpressure Algorithm for Coping with Network Congestion

We consider the problem of minimizing the delay of jobs moving through a...
research
βˆ™ 05/18/2022

Deterministic Near-Optimal Distributed Listing of Cliques

The importance of classifying connections in large graphs has been the m...
research
βˆ™ 12/05/2019

Power of Pre-Processing: Production Scheduling with Variable Energy Pricing and Power-Saving States

This paper addresses a single machine scheduling problem with non-preemp...

Please sign up or login with your details

Forgot password? Click here to reset