Machine Learning Based Prediction and Classification of Computational Jobs in Cloud Computing Centers

03/09/2019
by   Zheqi Zhu, et al.
0

With the rapid growth of the data volume and the fast increasing of the computational model complexity in the scenario of cloud computing, it becomes an important topic that how to handle users' requests by scheduling computational jobs and assigning the resources in data center. In order to have a better perception of the computing jobs and their requests of resources, we analyze its characteristics and focus on the prediction and classification of the computing jobs with some machine learning approaches. Specifically, we apply LSTM neural network to predict the arrival of the jobs and the aggregated requests for computing resources. Then we evaluate it on Google Cluster dataset and it shows that the accuracy has been improved compared to the current existing methods. Additionally, to have a better understanding of the computing jobs, we use an unsupervised hierarchical clustering algorithm, BIRCH, to make classification and get some interpretability of our results in the computing centers.

READ FULL TEXT
research
05/22/2018

DRESS: Dynamic RESource-reservation Scheme for Congested Data-intensive Computing Platforms

In the past few years, we have envisioned an increasing number of busine...
research
03/05/2019

A Deep Learning based approach to VM behavior identification in cloud systems

Cloud computing data centers are growing in size and complexity to the p...
research
03/09/2021

Learning to Optimize DAG Scheduling in Heterogeneous Environment

Directed Acyclic Graph (DAG) scheduling in a heterogeneous environment i...
research
11/29/2022

ReAssigner: A Plug-and-Play Virtual Machine Scheduling Intensifier for Heterogeneous Requests

With the rapid development of cloud computing, virtual machine schedulin...
research
02/22/2021

Characterizing and Optimizing EDA Flows for the Cloud

Cloud computing accelerates design space exploration in logic synthesis,...
research
03/10/2022

Efficient Runtime Profiling for Black-box Machine Learning Services on Sensor Streams

In highly distributed environments such as cloud, edge and fog computing...
research
10/05/2016

10-millisecond Computing

Despite computation becomes much complex on data with an unprecedented s...

Please sign up or login with your details

Forgot password? Click here to reset