Vantage
- 4 June 2011
- journal article
- conference paper
- Published by Association for Computing Machinery (ACM) in ACM SIGARCH Computer Architecture News
- Vol. 39 (3), 57-68
- https://doi.org/10.1145/2024723.2000073
Abstract
Cache partitioning has a wide range of uses in CMPs, from guaranteeing quality of service and controlled sharing to security-related techniques. However, existing cache partitioning schemes (such as way-partitioning) are limited to coarse-grain allocations, can only support few partitions, and reduce cache associativity, hurting performance. Hence, these techniques can only be applied to CMPs with 2-4 cores, but fail to scale to tens of cores. We present Vantage, a novel cache partitioning technique that overcomes the limitations of existing schemes: caches can have tens of partitions with sizes specified at cache line granularity, while maintaining high associativity and strong isolation among partitions. Vantage leverages cache arrays with good hashing and associativity, which enable soft-pinning a large portion of cache lines. It enforces capacity allocations by controlling the replacement process. Unlike prior schemes, Vantage provides strict isolation guarantees by partitioning most (e.g. 90%) of the cache instead of all of it. Vantage is derived from analytical models, which allow us to provide strong guarantees and bounds on associativity and sizing independent of the number of partitions and their behaviors. It is simple to implement, requiring around 1.5% state overhead and simple changes to the cache controller. We evaluate Vantage using extensive simulations. On a 32-core system, using 350 multiprogrammed workloads and one partition per core, partitioning the last-level cache with conventional techniques degrades throughput for 71% of the workloads versus an unpartitioned cache (by 7% average, 25% maximum degradation), even when using 64-way caches. In contrast, Vantage improves throughput for 98% of the workloads, by 8% on average (up to 20%), using a 4-way cache .Keywords
This publication has 17 references indexed in Scilit:
- High performance cache replacement using re-reference interval prediction (RRIP)Published by Association for Computing Machinery (ACM) ,2010
- PIPPPublished by Association for Computing Machinery (ACM) ,2009
- Adaptive insertion policies for managing shared cachesPublished by Association for Computing Machinery (ACM) ,2008
- From chaos to QoSACM SIGARCH Computer Architecture News, 2007
- Communist, utilitarian, and capitalist cache policies on CMPsPublished by Association for Computing Machinery (ACM) ,2006
- Bulk Disambiguation of Speculative Threads in MultiprocessorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- PinPublished by Association for Computing Machinery (ACM) ,2005
- Reconfigurable caches and their application to media processingPublished by Association for Computing Machinery (ACM) ,2000
- Application-specific memory management for embedded systems using software-controlled cachesPublished by Association for Computing Machinery (ACM) ,2000
- Universal classes of hash functions (Extended Abstract)Published by Association for Computing Machinery (ACM) ,1977