Online Social Welfare Maximization with Spatio-Temporal Resource Mesh for Serverless

12/05/2021
by   Hailiang Zhao, et al.
0

Serverless computing is leading the way to a simplified and general purpose programming model for the cloud. A key enabler behind serverless is efficient load balancing, which routes continuous workloads to appropriate backend resources. However, current load balancing algorithms implemented in Kubernetes native serverless platforms are simple heuristics without performance guarantee. Although policies such as Pod or JFIQ yield asymptotically optimal mean response time, the information they depend on are usually unavailable. In addition, dispatching jobs with strict deadlines, fractional workloads, and maximum parallelism bound to limited resources online is difficult because the resource allocation decisions for jobs are intertwined. To design an online load balancing algorithm without assumptions on distributions while maximizing the social welfare, we construct several pseudo-social welfare functions and cost functions, where the latter is to estimate the marginal cost for provisioning services to every newly arrived job based on present resource surplus. The proposed algorithm, named OnSocMax, works by following the solutions of several convex pseudo-social welfare maximization problems. It is proved to be α-competitive for some α at least 2. We also validate OnSocMax with simulations and the results show that it distinctly outperforms several handcrafted benchmarks.

READ FULL TEXT

page 1

page 2

research
07/16/2020

Nash Social Welfare in Selfish and Online Load Balancing

In load balancing problems there is a set of clients, each wishing to se...
research
04/09/2022

Learning to Dispatch Multi-Server Jobs in Bipartite Graphs with Unknown Service Rates

Multi-server jobs are imperative in modern cloud computing systems. A mu...
research
09/10/2019

Well-behaved Online Load Balancing Against Strategic Jobs

In the online load balancing problem on related machines, we have a set ...
research
11/06/2017

Social Welfare and Profit Maximization from Revealed Preferences

Consider the seller's problem of finding "optimal" prices for her (divis...
research
11/18/2018

The Preemptive Resource Allocation Problem

We revisit a classical scheduling model to incorporate modern trends in ...
research
10/07/2018

A General Sensitivity Analysis Approach for Demand Response Optimizations

It is well-known that demand response can improve the system efficiency ...
research
03/23/2021

Taming Time-Varying Information Asymmetry in Fresh Status Acquisition

Many online platforms are providing valuable real-time contents (e.g., t...

Please sign up or login with your details

Forgot password? Click here to reset