PaRSEC: Exploiting Heterogeneity to Enhance Scalability
Top Cited Papers
- 4 November 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Computing in Science & Engineering
- Vol. 15 (6), 36-45
- https://doi.org/10.1109/mcse.2013.98
Abstract
New high-performance computing system designs with steeply escalating processor and core counts, burgeoning heterogeneity and accelerators, and increasingly unpredictable memory access times call for one or more dramatically new programming paradigms. These new approaches must react and adapt quickly to unexpected contentions and delays, and they must provide the execution environment with sufficient intelligence and flexibility to rearrange the execution to improve resource utilization. The authors present an approach based on task parallelism that reveals the application's parallelism by expressing its algorithm as a task flow. This strategy allows the algorithm to be decoupled from the data distribution and the underlying hardware, since the algorithm is entirely expressed as flows of data. This kind of layering provides a clear separation of concerns among architecture, algorithm, and data distribution. Developers benefit from this separation because they can focus solely on the algorithmic level without the constraints involved with programming for current and future hardware trends.This publication has 6 references indexed in Scilit:
- Towards a codelet-based runtime for exascale computingPublished by Association for Computing Machinery (ACM) ,2012
- StarPU: a unified platform for task scheduling on heterogeneous multicore architecturesConcurrency and Computation: Practice and Experience, 2010
- ParalleX An Advanced Parallel Execution Model for Scaling-Impaired ApplicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- Hierarchical Task-Based Programming With StarSsThe International Journal of High Performance Computing Applications, 2009
- AUTOMATIC PARALLELIZATION TECHNIQUES BASED ON COMPACT DAG EXTRACTION AND SYMBOLIC SCHEDULINGParallel Processing Letters, 2001
- Analysis of Programs for Parallel ProcessingIEEE Transactions on Electronic Computers, 1966