Cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds
Top Cited Papers
- 1 November 2012
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Large-scale applications expressed as scientific workflows are often grouped into ensembles of inter-related workflows. In this paper, we address a new and important problem concerning the efficient management of such ensembles under budget and deadline constraints on Infrastructure- as-aService (IaaS) clouds. We discuss, develop, and assess algorithms based on static and dynamic strategies for both task scheduling and resource provisioning. We perform the evaluation via simulation using a set of scientific workflow ensembles with a broad range of budget and deadline parameters, taking into account uncertainties in task runtime estimations, provisioning delays, and failures. We find that the key factor determining the performance of an algorithm is its ability to decide which workflows in an ensemble to admit or reject for execution. Our results show that an admission procedure based on workflow structure and estimates of task runtimes can significantly improve the quality of solutions.Keywords
This publication has 19 references indexed in Scilit:
- Autonomic Management of Application Workflows on Hybrid Computing InfrastructureScientific Programming, 2011
- Cost-driven scheduling of grid workflows using Partial Critical PathsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing EnvironmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Scientific workflow applications on Amazon EC2Published by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Bi-Criteria Scheduling of Scientific Grid WorkflowsIEEE Transactions on Automation Science and Engineering, 2009
- Towards a general model of the multi-criteria workflow scheduling on the gridFuture Generation Computer Systems, 2009
- Multiobjective differential evolution for scheduling workflow applications on global GridsConcurrency and Computation: Practice and Experience, 2009
- Characterization of scientific workflowsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Scheduling Workflows with Budget ConstraintsPublished by Springer Science and Business Media LLC ,2006
- Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed SystemsScientific Programming, 2005