Scheduling Methods to Reduce Response Latency of Function as a Service

08/11/2020
by   Pawel Zuk, et al.
0

Function as a Service (FaaS) permits cloud customers to deploy to cloud individual functions, in contrast to complete virtual machines or Linux containers. All major cloud providers offer FaaS products (Amazon Lambda, Google Cloud Functions, Azure Serverless); there are also popular open-source implementations (Apache OpenWhisk) with commercial offerings (Adobe I/O Runtime, IBM Cloud Functions). A new feature of FaaS is function composition: a function may (sequentially) call another function, which, in turn, may call yet another function - forming a chain of invocations. From the perspective of the infrastructure, a composed FaaS is less opaque than a virtual machine or a container. We show that this additional information enables the infrastructure to reduce the response latency. In particular, knowing the sequence of future invocations, the infrastructure can schedule these invocations along with environment preparation. We model resource management in FaaS as a scheduling problem combining (1) sequencing of invocations, (2) deploying execution environments on machines, and (3) allocating invocations to deployed environments. For each aspect, we propose heuristics. We explore their performance by simulation on a range of synthetic workloads. Our results show that if the setup times are long compared to invocation times, algorithms that use information about the composition of functions consistently outperform greedy, myopic algorithms, leading to significant decrease in response latency.

READ FULL TEXT
research
05/07/2021

Data-driven scheduling in serverless computing to reduce response time

In Function as a Service (FaaS), a serverless computing variant, custome...
research
11/21/2017

Efficient image deployment in cloud environments

The biggest overhead for the instantiation of a virtual machine in a clo...
research
05/28/2019

Function-as-a-Service Benchmarking Framework

Cloud Service Providers deliver their products in form of 'as-a-Service'...
research
03/28/2019

Mitigating Cold Starts in Serverless Platforms: A Pool-Based Approach

Rapid adoption of the serverless (or Function-as-a-Service, FaaS) paradi...
research
09/04/2022

SFS: Smart OS Scheduling for Serverless Functions

Serverless computing enables a new way of building and scaling cloud app...
research
02/28/2018

i2kit: A Tool for Immutable Infrastructure Deployments based on Lightweight Virtual Machines specialized to run Containers

Container technologies, like Docker, are becoming increasingly popular. ...
research
05/22/2023

On-demand Container Loading in AWS Lambda

AWS Lambda is a serverless event-driven compute service, part of a categ...

Please sign up or login with your details

Forgot password? Click here to reset