Uncertainty-Aware Workload Prediction in Cloud Computing

02/24/2023
by   Andrea Rossi, et al.
0

Predicting future resource demand in Cloud Computing is essential for managing Cloud data centres and guaranteeing customers a minimum Quality of Service (QoS) level. Modelling the uncertainty of future demand improves the quality of the prediction and reduces the waste due to overallocation. In this paper, we propose univariate and bivariate Bayesian deep learning models to predict the distribution of future resource demand and its uncertainty. We design different training scenarios to train these models, where each procedure is a different combination of pretraining and fine-tuning steps on multiple datasets configurations. We also compare the bivariate model to its univariate counterpart training with one or more datasets to investigate how different components affect the accuracy of the prediction and impact the QoS. Finally, we investigate whether our models have transfer learning capabilities. Extensive experiments show that pretraining with multiple datasets boosts performances while fine-tuning does not. Our models generalise well on related but unseen time series, proving transfer learning capabilities. Runtime performance analysis shows that the models are deployable in real-world applications. For this study, we preprocessed twelve datasets from real-world traces in a consistent and detailed way and made them available to facilitate the research in this field.

READ FULL TEXT
research
04/14/2022

RobustScaler: QoS-Aware Autoscaling for Complex Workloads

Autoscaling is a critical component for efficient resource utilization w...
research
07/23/2022

RIBBON: Cost-Effective and QoS-Aware Deep Learning Model Inference using a Diverse Pool of Cloud Computing Instances

Deep learning model inference is a key service in many businesses and sc...
research
05/11/2020

Pretraining Federated Text Models for Next Word Prediction

Federated learning is a decentralized approach for training models on di...
research
04/22/2019

Exploring Unsupervised Pretraining and Sentence Structure Modelling for Winograd Schema Challenge

Winograd Schema Challenge (WSC) was proposed as an AI-hard problem in te...
research
03/14/2022

CAROL: Confidence-Aware Resilience Model for Edge Federations

In recent years, the deployment of large-scale Internet of Things (IoT) ...
research
05/19/2018

Robust Optimization over Multiple Domains

Recently, machine learning becomes important for the cloud computing ser...

Please sign up or login with your details

Forgot password? Click here to reset