A simple and effective predictive resource scaling heuristic for large-scale cloud applications

08/03/2020
by   Valentin Flunkert, et al.
0

We propose a simple yet effective policy for the predictive auto-scaling of horizontally scalable applications running in cloud environments, where compute resources can only be added with a delay, and where the deployment throughput is limited. Our policy uses a probabilistic forecast of the workload to make scaling decisions dependent on the risk aversion of the application owner. We show in our experiments using real-world and synthetic data that this policy compares favorably to mathematically more sophisticated approaches as well as to simple benchmark policies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/29/2020

AI-based Resource Allocation: Reinforcement Learning for Adaptive Auto-scaling in Serverless Environments

Serverless computing has emerged as a compelling new paradigm of cloud c...
research
11/03/2021

Predictive Auto-scaling with OpenStack Monasca

Cloud auto-scaling mechanisms are typically based on reactive automation...
research
05/24/2021

FaaSNet: Scalable and Fast Provisioning of Custom Serverless Container Runtimes at Alibaba Cloud Function Compute

Serverless computing, or Function-as-a-Service (FaaS), enables a new way...
research
01/23/2021

Scaling Scientometrics: Dimensions on Google BigQuery as an infrastructure for large-scale analysis

Cloud computing has the capacity to transform many parts of the research...
research
11/22/2022

A case study of proactive auto-scaling for an ecommerce workload

Preliminary data obtained from a partnership between the Federal Univers...
research
10/15/2020

Towards Self-Improving Hybrid Elasticity Control of Cloud-based Software Systems

Elasticity is a form of self-adaptivity in cloud-based software systems ...
research
03/15/2022

Cost-effective BlackWater Raft on Highly Unreliable Nodes at Scale Out

The Raft algorithm maintains strong consistency across data replicas in ...

Please sign up or login with your details

Forgot password? Click here to reset