Topology-aware resource allocation for data-intensive workloads
- 22 January 2011
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGCOMM Computer Communication Review
- Vol. 41 (1), 120-124
- https://doi.org/10.1145/1925861.1925881
Abstract
This paper proposes an architecture for optimized resource allocation in Infrastructure-as-a-Service (IaaS)-based cloud systems. Current IaaS systems are usually unaware of the hosted application's requirements and therefore allocate resources independently of its needs, which can significantly impact performance for distributed data-intensive applications. To address this resource allocation problem, we propose an architecture that adopts a what if methodology to guide allocation decisions taken by the IaaS. The architecture uses a prediction engine with a lightweight simulator to estimate the performance of a given resource allocation and a genetic algorithm to find an optimized solution in the large search space. We have built a prototype for Topology-Aware Resource Allocation (TARA) and evaluated it on a 80 server cluster with two representative MapReduce-based benchmarks. Our results show that TARA reduces the job completion time of these applications by up to 59% when compared to application-independent allocation policies.Keywords
This publication has 9 references indexed in Scilit:
- Hey, you, get off of my cloudPublished by Association for Computing Machinery (ACM) ,2009
- QuincyPublished by Association for Computing Machinery (ACM) ,2009
- VL2Published by Association for Computing Machinery (ACM) ,2009
- BCubePublished by Association for Computing Machinery (ACM) ,2009
- MapReduce optimization using regulated dynamic prioritizationPublished by Association for Computing Machinery (ACM) ,2009
- The Eucalyptus Open-Source Cloud-Computing SystemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- A scalable, commodity data center network architecturePublished by Association for Computing Machinery (ACM) ,2008
- Policy-Based Resource Assignment in Utility Computing EnvironmentsLecture Notes in Computer Science, 2004
- Xen and the art of virtualizationPublished by Association for Computing Machinery (ACM) ,2003