COCOA: Cold Start Aware Capacity Planning for Function-as-a-Service Platforms

07/02/2020
by   Alim Ul Gias, et al.
0

Function-as-a-Service (FaaS) is increasingly popular in the software industry due to the implied cost-savings in event-driven workloads and its synergy with DevOps. To size an on-premise FaaS platform, it is important to estimate the required CPU and memory capacity to serve the expected loads. Given the service-level agreements, it is however challenging to take the cold start issue into account during the sizing process. We have investigated the similarity of this problem with the hit rate improvement problem in TTL caches and concluded that solutions for TTL cache, although potentially applicable, lead to over-provisioning in FaaS. Thus, we propose a novel approach, COCOA, to solve this issue. COCOA uses a queueing-based approach to assess the effect of cold starts on FaaS response times. It also considers different memory consumption values depending on whether the function is idle or in execution. Using an event-driven FaaS simulator, FaasSim, we have developed, we show that COCOA can reduce over-provisioning by over 70 satisfying the service-level agreements.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/15/2023

Reinforcement Learning (RL) Augmented Cold Start Frequency Reduction in Serverless Computing

Function-as-a-Service is a cloud computing paradigm offering an event-dr...
research
03/28/2019

Mitigating Cold Starts in Serverless Platforms: A Pool-Based Approach

Rapid adoption of the serverless (or Function-as-a-Service, FaaS) paradi...
research
05/11/2022

Uptime-Optimized Cloud Architecture as a Brokered Service

Enterprise workloads usually call for an uptime service level agreement ...
research
10/03/2019

SEUSS: Rapid serverless deployment using environment snapshots

Modern FaaS systems perform well in the case of repeat executions when f...
research
05/21/2020

Memory-Aware Denial-of-Service Attacks on Shared Cache in Multicore Real-Time Systems

In this paper, we identify that memory performance plays a crucial role ...
research
01/10/2019

Adaptive Event Dispatching in Serverless Computing Infrastructures

Serverless computing is an emerging Cloud service model. It is currently...
research
04/07/2020

Function-as-a-Service Performance Evaluation: A Multivocal Literature Review

Function-as-a-Service (FaaS) is one form of the serverless cloud computi...

Please sign up or login with your details

Forgot password? Click here to reset