Cost and Reliability Aware Scheduling of Workflows Across Multiple Clouds with Security Constraints

04/01/2023
by   Atherve Tekawade, et al.
0

Many real-world scientific workflows can be represented by a Directed Acyclic Graph (DAG), where each node represents a task and a directed edge signifies a dependency between two tasks. Due to the increasing computational resource requirements of these workflows, they are deployed on multi-cloud systems for execution. In this paper, we propose a scheduling algorithm that allocates resources to the tasks present in the workflow using an efficient list-scheduling approach based on the parameters cost, processing time, and reliability. Next, for a given a task-resource mapping, we propose a cipher assignment algorithm that assigns security services to edges responsible for transferring data in time-optimal manner subject to a given security constraint. The proposed algorithms have been analyzed to understand their time and space requirements. We implement the proposed scheduling and cipher assignment algorithm and experimented with two real-world scientific workflows namely Epigenomics and Cybershake. We compare the performance of the proposed scheduling algorithm with the state-of-art evolutionary methods. We observe that our method outperforms the state-of-art methods always in terms of cost and reliability, and is inferior in terms of makespan in some cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/18/2022

A Cost Effective Reliability Aware Scheduler for Task Graphs in Multi-Cloud System

Many scientific workflows can be represented by a Directed Acyclic Graph...
research
12/18/2022

CEDCES: A Cost Effective Deadline Constrained Evolutionary Scheduler for Task Graphs in Multi-Cloud System

Many scientific workflows can be modeled as a Directed Acyclic Graph (he...
research
08/28/2023

Edge Generation Scheduling for DAG Tasks using Deep Reinforcement Learning

Directed acyclic graph (DAG) tasks are currently adopted in the real-tim...
research
12/22/2021

Rightsizing Clusters for Time-Limited Tasks

In conventional public clouds, designing a suitable initial cluster for ...
research
05/02/2018

Generalising Cost-Optimal Particle Filtering

We present an instance of the optimal sensor scheduling problem with the...
research
12/19/2022

A Makespan and Energy-Aware Scheduling Algorithm for Workflows under Reliability Constraint on a Multiprocessor Platform

Many scientific workflows can be modeled as a Directed Acyclic Graph (he...
research
09/22/2020

A Fuzzy Logic Controller for Tasks Scheduling Using Unreliable Cloud Resources

The Cloud infrastructure offers to end users a broad set of heterogenous...

Please sign up or login with your details

Forgot password? Click here to reset