Online Application Guidance for Heterogeneous Memory Systems
Open Access
- 6 July 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 19 (3), 1-27
- https://doi.org/10.1145/3533855
Abstract
As scaling of conventional memory devices has stalled, many high-end computing systems have begun to incorporate alternative memory technologies to meet performance goals. Since these technologies present distinct advantages and tradeoffs compared to conventional DDR* SDRAM, such as higher bandwidth with lower capacity or vice versa, they are typically packaged alongside conventional SDRAM in a heterogeneous memory architecture. To utilize the different types of memory efficiently, new data management strategies are needed to match application usage to the best available memory technology. However, current proposals for managing heterogeneous memories are limited, because they either (1) do not consider high-level application behavior when assigning data to different types of memory or (2) require separate program execution (with a representative input) to collect information about how the application uses memory resources. This work presents a new data management toolset to address the limitations of existing approaches for managing complex memories. It extends the application runtime layer with automated monitoring and management routines that assign application data to the best tier of memory based on previous usage, without any need for source code modification or a separate profiling run. It evaluates this approach on a state-of-the-art server platform with both conventional DDR4 SDRAM and non-volatile Intel Optane DC memory, using both memory-intensive high-performance computing (HPC) applications as well as standard benchmarks. Overall, the results show that this approach improves program performance significantly compared to a standard unguided approach across a variety of workloads and system configurations. The HPC applications exhibit the largest benefits, with speedups ranging from 1.4× to 7× in the best cases. Additionally, we show that this approach achieves similar performance as a comparable offline profiling-based approach after a short startup period, without requiring separate program execution or offline analysis steps.Keywords
Funding Information
- Exascale Computing Project (17-SC-20-SC)
- U.S. Department of Energy Office of Science
- National Nuclear Security Administration
- National Science Foundation (CNS-1943305)
This publication has 48 references indexed in Scilit:
- A fully associative, tagless DRAM cachePublished by Association for Computing Machinery (ACM) ,2015
- Page Placement Strategies for GPUs within Heterogeneous Memory SystemsACM SIGPLAN Notices, 2015
- Flipping bits in memory without accessing themACM SIGARCH Computer Architecture News, 2014
- A framework for application guidance in virtual memory systemsPublished by Association for Computing Machinery (ACM) ,2013
- On-the-fly structure splitting for heap objectsACM Transactions on Architecture and Code Optimization, 2012
- Statistically rigorous java performance evaluationPublished by Association for Computing Machinery (ACM) ,2007
- Energy management for commercial serversComputer, 2003
- Cache-conscious data placementACM SIGPLAN Notices, 1998
- Segregating heap objects by reference behavior and lifetimeACM SIGPLAN Notices, 1998
- ExokernelACM SIGOPS Operating Systems Review, 1995