The Power of Machine Learning and Market Design for Cloud Computing Admission Control

04/20/2018
by   Ludwig Dierks, et al.
0

Cloud computing providers must handle customer workloads that wish to scale their use of resources such as virtual machines up and down over time. Currently, this is often done using simple threshold policies to reserve large parts of each cluster. This leads to low utilization of the cluster on average. In this paper, we propose more sophisticated policies for controlling admission to a cluster and demonstrate that our policies significantly increase cluster utilization. We first introduce a model and fit its parameters on a data trace from Microsoft Azure. We then design policies that estimate moments of each workload's distribution of future resource usage. Via simulations we show that, while estimating the first moments of workloads leads to a substantial improvement over the simple threshold policy, also taking the second moments into account yields another improvement in utilization. We then evaluate how much further this can be improved with learned or elicited prior information and how to incentivize users to provide this information.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2018

Bayesian Admission Policies for Cloud Computing Clusters

Cloud computing providers must handle customer workloads that wish to sc...
research
11/24/2017

Technical Report: A Trace-Based Performance Study of Autoscaling Workloads of Workflows in Datacenters

To improve customer experience, datacenter operators offer support for s...
research
01/10/2022

A Simulation Platform for Multi-tenant Machine Learning Services on Thousands of GPUs

Multi-tenant machine learning services have become emerging data-intensi...
research
11/14/2018

Anomaly Analysis for Co-located Datacenter Workloads in the Alibaba Cluster

In warehouse-scale cloud datacenters, co-locating online services and of...
research
09/18/2020

Akita: A CPU scheduler for virtualized Clouds

Clouds inherit CPU scheduling policies of operating systems. These polic...
research
04/08/2020

Hedge Your Bets: Optimizing Long-term Cloud Costs by Mixing VM Purchasing Options

Cloud platforms offer the same VMs under many purchasing options that sp...
research
06/30/2022

Exploiting Inherent Elasticity of Serverless in Irregular Algorithms

Serverless computing, in particular the Function-as-a-Service (FaaS) exe...

Please sign up or login with your details

Forgot password? Click here to reset