CEDCES: A Cost Effective Deadline Constrained Evolutionary Scheduler for Task Graphs in Multi-Cloud System

12/18/2022
by   Atharva Tekawade, et al.
0

Many scientific workflows can be modeled as a Directed Acyclic Graph (henceforth mentioned as DAG) where the nodes represent individual tasks and the directed edges represent data and control flow dependency between two tasks. Due to large computational resource requirements, a single cloud cannot meet the requirements of the workflow. Hence, a multi-cloud system, where multiple cloud providers pool their resources together becomes a good solution. The major objectives considered while scheduling the tasks present in a task graph include execution cost and makespan. In this paper, we present Cost Effective Deadline Constrained Evolutionary Scheduler (henceforth mentioned as CEDCES) which aims to minimize the execution cost under a given deadline constraint. CEDCES contains Particle Swarm Optimization-based (henceforth mentioned as PSO) method in its core, however includes novel initialization, crossover, and mutation schemes. Extensive simulation experiments on real-world workflows show that CEDCES outperforms the state-of-art algorithms, in particular, 60.41 deadline is violated, CEDCES gives the least overshoot in execution time and outperforming the others by 10.96

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2023

Cost and Reliability Aware Scheduling of Workflows Across Multiple Clouds with Security Constraints

Many real-world scientific workflows can be represented by a Directed Ac...
research
12/18/2022

A Cost Effective Reliability Aware Scheduler for Task Graphs in Multi-Cloud System

Many scientific workflows can be represented by a Directed Acyclic Graph...
research
12/19/2022

A Makespan and Energy-Aware Scheduling Algorithm for Workflows under Reliability Constraint on a Multiprocessor Platform

Many scientific workflows can be modeled as a Directed Acyclic Graph (he...
research
12/23/2019

Jupiter: A Networked Computing Architecture

In the era of Internet of Things, there is an increasing demand for netw...
research
02/11/2022

Global Optimization of Data Pipelines in Heterogeneous Cloud Environments

Modern production data processing and machine learning pipelines on the ...
research
10/14/2019

In Search of a Fast and Efficient Serverless DAG Engine

Python-written data analytics applications can be modeled as and compile...
research
12/10/2020

Descriptive and Predictive Analysis of Aggregating Functions in Serverless Clouds: the Case of Video Streaming

Serverless clouds allocate multiple tasks (e.g., micro-services) from mu...

Please sign up or login with your details

Forgot password? Click here to reset