Partitioning Cloud-based Microservices (via Deep Learning)

09/29/2021
by   Rahul Yedida, et al.
0

Cloud-based software has many advantages. When services are divided into many independent components, they are easier to update. Also, during peak demand, it is easier to scale cloud services (just hire more CPUs). Hence, many organizations are partitioning their monolithic enterprise applications into cloud-based microservices. Recently there has been much work using machine learning to simplify this partitioning task. Despite much research, no single partitioning method can be recommended as generally useful. More specifically, those prior solutions are "brittle”; i.e. if they work well for one kind of goal in one dataset, then they can be sub-optimal if applied to many datasets and multiple goals. In order to find a generally useful partitioning method, we propose DEEPLY. This new algorithm extends the CO-GCN deep learning partition generator with (a) a novel loss function and (b) some hyper-parameter optimization. As shown by our experiments, DEEPLY generally outperforms prior work (including CO-GCN, and others) across multiple datasets and goals. To the best of our knowledge, this is the first report in SE of such stable hyper-parameter optimization. To aid reuse of this work, DEEPLY is available on-line at https://bit.ly/2WhfFlB.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/26/2022

More Recent Advances in (Hyper)Graph Partitioning

In recent years, significant advances have been made in the design and e...
research
06/12/2021

Lessons learned from hyper-parameter tuning for microservice candidate identification

When optimizing software for the cloud, monolithic applications need to ...
research
06/17/2020

Maximum Roaming Multi-Task Learning

Multi-task learning has gained popularity due to the advantages it provi...
research
10/07/2019

Dynamic Self-training Framework for Graph Convolutional Networks

Graph neural networks (GNN) such as GCN, GAT, MoNet have achieved state-...
research
07/11/2017

An Optimal Bayesian Network Based Solution Scheme for the Constrained Stochastic On-line Equi-Partitioning Problem

A number of intriguing decision scenarios revolve around partitioning a ...
research
05/09/2019

NeuPart: Using Analytical Models to Drive Energy-Efficient Partitioning of CNN Computations on Cloud-Connected Mobile Clients

Data processing on convolutional neural networks (CNNs) places a heavy b...
research
07/10/2020

Neural Knowledge Extraction From Cloud Service Incidents

In the last decade, two paradigm shifts have reshaped the software indus...

Please sign up or login with your details

Forgot password? Click here to reset