Archipelago: A Scalable Low-Latency Serverless Platform

11/22/2019
by   Arjun Singhvi, et al.
0

The increased use of micro-services to build web applications has spurred the rapid growth of Function-as-a-Service (FaaS) or serverless computing platforms. While FaaS simplifies provisioning and scaling for application developers, it introduces new challenges in resource management that need to be handled by the cloud provider. Our analysis of popular serverless workloads indicates that schedulers need to handle functions that are very short-lived, have unpredictable arrival patterns, and require expensive setup of sandboxes. The challenge of running a large number of such functions in a multi-tenant cluster makes existing scheduling frameworks unsuitable. We present Archipelago, a platform that enables low latency request execution in a multi-tenant serverless setting. Archipelago views each application as a DAG of functions, and every DAG in associated with a latency deadline. Archipelago achieves its per-DAG request latency goals by: (1) partitioning a given cluster into a number of smaller worker pools, and associating each pool with a semi-global scheduler (SGS), (2) using a latency-aware scheduler within each SGS along with proactive sandbox allocation to reduce overheads, and (3) using a load balancing layer to route requests for different DAGs to the appropriate SGS, and automatically scale the number of SGSs per DAG. Our testbed results show that Archipelago meets the latency deadline for more than 99 up to 36X compared to state-of-the-art serverless platforms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/06/2023

FaaSwap: SLO-Aware, GPU-Efficient Serverless Inference via Model Swapping

The dynamic request patterns of machine learning (ML) inference workload...
research
03/28/2019

Mitigating Cold Starts in Serverless Platforms: A Pool-Based Approach

Rapid adoption of the serverless (or Function-as-a-Service, FaaS) paradi...
research
08/28/2020

Fifer: Tackling Underutilization in the Serverless Era

Datacenters are witnessing a rapid surge in the adoption of serverless f...
research
08/27/2022

Apiary: A DBMS-Backed Transactional Function-as-a-Service Framework

Developers are increasingly using function-as-a-service (FaaS) platforms...
research
07/18/2019

Asynchronous Snapshots of Actor Systems for Latency-Sensitive Applications

The actor model is popular for many types of server applications. Effici...
research
09/28/2021

Restructuring Serverless Computing with Data-Centric Function Orchestration

Serverless applications are usually composed of multiple short-lived, si...
research
05/03/2023

Scheduling Network Function Chains Under Sub-Millisecond Latency SLOs

Network Function Virtualization (NFV) seeks to replace hardware middlebo...

Please sign up or login with your details

Forgot password? Click here to reset