TY  - CONF
AU  - Mateevitsi, Victor A.
AU  - Bode, Mathis
AU  - Ferrier, Nicola
AU  - Fischer, Paul
AU  - Göbbert, Jens Henrik
AU  - Insley, Joseph A.
AU  - Lan, Yu-Hsiang
AU  - Min, Misun
AU  - Papka, Michael E.
AU  - Patel, Saumil
AU  - Rizzi, Silvio
AU  - Windgassen, Jonathan
TI  - Scaling Computational Fluid Dynamics: In Situ Visualization of NekRS using SENSEI
CY  - New York, USA
PB  - Association for Computing Machinery
M1  - FZJ-2024-03256
SN  - 9798400707858
SP  - 862–867
PY  - 2023
AB  - In the realm of Computational Fluid Dynamics (CFD), the demand for memory and computation resources is extreme, necessitating the use of leadership-scale computing platforms for practical domain sizes. This intensive requirement renders traditional checkpointing methods ineffective due to the significant slowdown in simulations while saving state data to disk. As we progress towards exascale and GPU-driven High-Performance Computing (HPC) and confront larger problem sizes, the choice becomes increasingly stark: to compromise data fidelity or to reduce resolution. To navigate this challenge, this study advocates for the use of in situ analysis and visualization techniques. These allow more frequent data "snapshots" to be taken directly from memory, thus avoiding the need for disruptive checkpointing. We detail our approach of instrumenting NekRS, a GPU-focused thermal-fluid simulation code employing the spectral element method (SEM), and describe varied in situ and in transit strategies for data rendering. Additionally, we provide concrete scientific use-cases and report on runs performed on Polaris, Argonne Leadership Computing Facility’s (ALCF) 44 Petaflop supercomputer and Jülich Wizard for European Leadership Science (JUWELS) Booster, Jülich Supercomputing Centre’s (JSC) 71 Petaflop High Performance Computing (HPC) system, offering practical insight into the implications of our methodology.
T2  - Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
CY  - 12 Nov 2023 - 17 Nov 2023, Denver, CO (USA)
Y2  - 12 Nov 2023 - 17 Nov 2023
M2  - Denver, CO, USA
LB  - PUB:(DE-HGF)8 ; PUB:(DE-HGF)7
DO  - DOI:10.1145/3624062.3624159
UR  - https://juser.fz-juelich.de/record/1026000
ER  -