CacheInspector
Open Access
- 8 June 2021
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 18 (3), 1-25
- https://doi.org/10.1145/3457373
Abstract
Infrastructure-as-a-Service cloud providers sell virtual machines that are only specified in terms of number of CPU cores, amount of memory, and I/O throughput. Performance-critical aspects such as cache sizes and memory latency are missing or reported in ways that make them hard to compare across cloud providers. It is difficult for users to adapt their application’s behavior to the available resources. In this work, we aim to increase the visibility that cloud users have into shared resources on public clouds. Specifically, we present CacheInspector , a lightweight runtime that determines the performance and allocated capacity of shared caches on multi-tenant public clouds. We validate CacheInspector ’s accuracy in a controlled environment, and use it to study the characteristics and variability of cache resources in the cloud, across time, instances, availability regions, and cloud providers. We show that CacheInspector ’s output allows cloud users to tailor their application’s behavior, including their output quality, to avoid suboptimal performance when resources are scarce.Keywords
Funding Information
- National Institute of Standards and Technology (70NANB17H181)
- NSF (1955125,CCF-1846046,CSR-1704742)
This publication has 38 references indexed in Scilit:
- HeraclesPublished by Association for Computing Machinery (ACM) ,2015
- SiriusACM SIGPLAN Notices, 2015
- Revisiting hardware-assisted page walks for virtualized systemsACM SIGARCH Computer Architecture News, 2012
- VantageACM SIGARCH Computer Architecture News, 2011
- High performance cache replacement using re-reference interval prediction (RRIP)ACM SIGARCH Computer Architecture News, 2010
- Accelerating two-dimensional page walks for virtualized systemsACM SIGPLAN Notices, 2008
- ValgrindACM SIGPLAN Notices, 2007
- A performance counter architecture for computing accurate CPI componentsACM SIGOPS Operating Systems Review, 2006
- Tile size selection using cache organization and data layoutACM SIGPLAN Notices, 1995
- The cache performance and optimizations of blocked algorithmsACM SIGARCH Computer Architecture News, 1991