VM auto-scaling methods for high throughput computing on hybrid infrastructure
- 3 June 2015
- journal article
- research article
- Published by Springer Science and Business Media LLC in Cluster Computing
- Vol. 18 (3), 1063-1073
- https://doi.org/10.1007/s10586-015-0462-8
Abstract
Cloud computing provides on-demand resource provisioning and scalable resources dynamically for the efficient use of computing resources. Scientific applications recently need a very large number of loosely coupled tasks to be handled efficiently. In response, current computing environments often consist of heterogeneous resources such as cloud computing. To effectively use cloud resources, auto-scaling methods that consider diverse metrics such as CPU utilization and costs of resource usage have been studied widely. However it still remains a challenge to automatically and timely allocate resources such that deadline violation and application types are considered. In this paper, we propose auto-scaling methods that consider specific conditions such as application types, task dependency, user-defined deadlines and data transfer times within a hybrid computing infrastructure. Our hybrid computing infrastructure consists of local cluster and cloud resources using HTCaaS. We observe noticeable improvements in performance when our auto-scaling methods for bag-of-tasks and workflow applications is applied.Keywords
This publication has 12 references indexed in Scilit:
- A Review of Auto-scaling Techniques for Elastic Applications in Cloud EnvironmentsJournal of Grid Computing, 2014
- Vertical/Horizontal Resource Scaling Mechanism for Federated CloudsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Monitoring and Autoscaling IaaS Clouds: A Case for Complex Event Processing on Data StreamsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Scaling and Scheduling to Maximize Application Performance within Budget Constraints in Cloud WorkflowsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service CloudsFuture Generation Computer Systems, 2013
- SmartScale: Automatic Application Scaling in Enterprise CloudsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithmsSoftware: Practice and Experience, 2010
- NCBI BLAST: a better web interfaceNucleic Acids Research, 2008
- A performance‐oriented adaptive scheduler for dependent tasks on gridsConcurrency and Computation: Practice and Experience, 2007
- PSI-BLAST TutorialMethods in Molecular Biology, 2007