Is the Same Instance Type Created Equal? Exploiting Heterogeneity of Public Clouds
- 4 November 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cloud Computing
- Vol. 1 (2), 201-214
- https://doi.org/10.1109/tcc.2013.12
Abstract
Public cloud platforms might start with homogeneous hardware; nevertheless, because of inevitable hardware upgrades, or adding more capacity, the initial homogeneous platform will gradually evolve into heterogeneous as time passes by. The consequent performance heterogeneity is of concern to cloud users. In this paper, we evaluate performance variations from hardware heterogeneity and scheduling mechanisms of public clouds. Amazon Elastic Compute Cloud (Amazon EC2) and Rackspace Cloud are used as the representatives because of their relatively long record and wide usage among small and medium enterprises (SMEs). A comprehensive set of microbenchmarks and application-level macrobenchmarks have been used to investigate performance variation. Several major contributions have been made. First, we find out that heterogeneous hardware is a commonality among the relatively long-lasting cloud platforms, although the level of heterogeneity varies. Second, we observe that heterogeneous hardware is the primary culprit of performance variation of cloud platforms. Third, we discover that varied CPU acquisition percentages and different virtual machine scheduling mechanisms exacerbate the performance variation problem, especially for network related operations. Finally, based on the observations, we propose cost-saving approaches and analyze Nash equilibrium from cloud user perspective. By using a simple "trial-and-better" approach, i.e., keep good-performing instances and discard bad-performing instances, cloud users can achieve up to 30 percent cost saving.Keywords
This publication has 15 references indexed in Scilit:
- More for your moneyPublished by Association for Computing Machinery (ACM) ,2012
- CloudProphetPublished by Association for Computing Machinery (ACM) ,2011
- What Are You Paying For? Performance Benchmarking for Infrastructure-as-a-Service OfferingsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Runtime measurements in the cloudProceedings of the VLDB Endowment, 2010
- Benchmarking cloud serving systems with YCSBPublished by Association for Computing Machinery (ACM) ,2010
- The Impact of Virtualization on Network Performance of Amazon EC2 Data CenterPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- A Common Business Object Design and Implementation of Regulatory Framework Based on MVCPublished by ASME International ,2010
- Comparison of the three CPU schedulers in XenACM SIGMETRICS Performance Evaluation Review, 2007
- Xen and the art of virtualizationPublished by Association for Computing Machinery (ACM) ,2003
- The design and implementation of an operating system to support distributed multimedia applicationsIEEE Journal on Selected Areas in Communications, 1996