iBench: Quantifying interference for datacenter applications
- 1 September 2013
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Interference between co-scheduled applications is one of the major reasons that causes modern datacenters (DCs) to operate at low utilization. DC operators traditionally side-step interference either by disallowing colocation altogether and providing isolated server instances, or by requiring the users to express resource reservations, which are often exaggerated to counter-balance the unpredictability in the quality of allocated resources. Understanding, reducing and managing interference can significantly impact the manner in which these large-scale systems operate. We present iBench, a novel workload suite that helps quantify the pressure different applications put in various shared resources, and similarly the pressure they can tolerate in these resources. iBench consists of a set of carefully-crafted benchmarks that induce interference of increasing intensity in resources that span the CPU, cache hierarchy, memory, storage and networking subsystems. We first validate the effect that iBench workloads have on performance against a wide spectrum of DC applications. Then, we use iBench to demonstrate the importance of considering interference in a set of challenging problems that range from DC scheduling and server provisioning, to resource-efficient application development and scheduling for heterogeneous CMPs. In all cases quantifying interference with iBench results in significant performance and/or efficiency improvements. We plan to release iBench under a free software license.Keywords
This publication has 24 references indexed in Scilit:
- ZSimPublished by Association for Computing Machinery (ACM) ,2013
- CPI 2Published by Association for Computing Machinery (ACM) ,2013
- Clearing the cloudsPublished by Association for Computing Machinery (ACM) ,2012
- Decoupling datacenter studies from access to large-scale applications: A modeling approach for storage workloadsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Power management of online data-intensive servicesACM SIGARCH Computer Architecture News, 2011
- The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale MachinesSynthesis Lectures on Computer Architecture, 2009
- MineBench: A Benchmark Suite for Data Mining WorkloadsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Last Level Cache (LLC) Performance of Data Mining Workloads On a CMP - A Case Study of Parallel Bioinformatics WorkloadsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- The SPLASH-2 programs: characterization and methodological considerationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- TCP/IP traffic dynamics and network performanceACM SIGCOMM Computer Communication Review, 2001