CMI: An Online Multi-objective Genetic Autoscaler for Scientific and Engineering Workflows in Cloud Infrastructures with Unreliable Virtual Machines

11/02/2018
by   David A. Monge, et al.
0

Cloud Computing is becoming the leading paradigm for executing scientific and engineering workflows. The large-scale nature of the experiments they model and their variable workloads make clouds the ideal execution environment due to prompt and elastic access to huge amounts of computing resources. Autoscalers are middleware-level software components that allow scaling up and down the computing platform by acquiring or terminating virtual machines (VM) at the time that workflow's tasks are being scheduled. In this work we propose a novel online multi-objective autoscaler for workflows denominated Cloud Multi-objective Intelligence (CMI), that aims at the minimization of makespan, monetary cost and the potential impact of errors derived from unreliable VMs. In addition, this problem is subject to monetary budget constraints. CMI is responsible for periodically solving the autoscaling problems encountered along the execution of a workflow. Simulation experiments on four well-known workflows exhibit that CMI significantly outperforms a state-of-the-art autoscaler of similar characteristics called Spot Instances Aware Autoscaling (SIAA). These results convey a solid base for deepening in the study of other meta-heuristic methods for autoscaling workflow applications using cheap but unreliable infrastructures.

READ FULL TEXT
research
06/06/2018

Resource Provisioning and Scheduling Algorithm for Meeting Cost and Deadline-Constraints of Scientific Workflows in IaaS Clouds

Infrastructure as a Service model of cloud computing is a desirable plat...
research
01/14/2022

Energy-efficient workflow scheduling based on workflow structures under deadline and budget constraints in the cloud

The utilization of cloud environments to deploy scientific workflow appl...
research
03/19/2018

Cloud Infrastructure Provenance Collection and Management to Reproduce Scientific Workflow Execution

The emergence of Cloud computing provides a new computing paradigm for s...
research
05/24/2019

Performance-Feedback Autoscaling with Budget Constraints for Cloud-based Workloads of Workflows

The growing popularity of workflows in the cloud domain promoted the dev...
research
04/16/2019

Reproducible Workflow on a Public Cloud for Computational Fluid Dynamics

In a new effort to make our research transparent and reproducible by oth...
research
09/08/2019

Performance considerations on execution of large scale workflow applications on cloud functions

Function-as-a-Service is a novel type of cloud service used for creating...
research
08/24/2021

The benefits of prefetching for large-scale cloud-based neuroimaging analysis workflows

To support the growing demands of neuroscience applications, researchers...

Please sign up or login with your details

Forgot password? Click here to reset