Progress in the transferability of fusion workflows across HPC systems
- 7 June 2021
- journal article
- research article
- Published by IOP Publishing in Plasma Physics and Controlled Fusion
- Vol. 63 (8), 084004
- https://doi.org/10.1088/1361-6587/ac08f8
Abstract
Understanding the behaviour of high-temperature plasmas is one of the main pillars in the development of fusion energy. It involves the development, validation, and use of several numerical models to describe complex physical processes and their interactions. Integrated modelling brings different models together, coupling them via suitable interfaces. Often, there is a need to include specific physics phenomena, such as magnetohydrodynamics, plasma turbulence or transport. They are computationally demanding and require modern supercomputers for their analysis. In such cases, the complexity of running integrated modelling workflows, including the use of supercomputers should be managed transparently, hidden to the final user. In this paper, we present and implement a scheme to tackle the execution of large fusion workflows on modern supercomputers using container technologies and a tool for their remote submission. We successfully packed in a container image a very complex environment: ITER IMAS. Moreover, we run HPC codes up to 3072 cores with performance loss of 3%. The ITER H&CD worklfow was executed on Marconi and for the first time ran in a cluster without an installation of the IMAS framework. The presented capabilities have demonstrated the feasibility of our approach to minimise the overhead on Marconi-Fusion, the European High-Performance Computer for fusion applications and have tested a relevant application within the integrated modelling community.Keywords
Funding Information
- European Commission
- H2020 Euratom
- EUROfusion Consortium
- EEG (AWP18-EEG-CIEMAT/Gutierrez)
- Polish Ministry of Science and Higher Education
This publication has 16 references indexed in Scilit:
- MARCONI-FUSION: The new high performance computing facility for European nuclear fusion modellingFusion Engineering and Design, 2018
- A Tale of Two Systems: Using Containers to Deploy HPC Applications on Supercomputers and CloudsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- One-dimensional plasma sheath model in front of the divertor platesPlasma Physics and Controlled Fusion, 2017
- Design and first applications of the ITER integrated modelling & analysis suiteNuclear Fusion, 2015
- SAGA: A standardized access layer to heterogeneous Distributed Computing InfrastructureSoftwareX, 2015
- The European Integrated Tokamak Modelling (ITM) effort: achievements and first physics resultsNuclear Fusion, 2014
- ASCOT: Solving the kinetic equation of minority particle species in tokamak plasmasComputer Physics Communications, 2014
- Application Scenarios Using Serpens Suite for Kepler Scientific Workflow SystemProcedia Computer Science, 2012
- Optimization of PIC codes by improved memory managementJournal of Computational Physics, 2007
- Scientific workflow management and the Kepler systemConcurrency and Computation: Practice and Experience, 2005