TY  - CONF
AU  - Maloney, Samuel
AU  - Suarez, Estela
AU  - Eicker, Norbert
AU  - Guimaraes, Filipe
AU  - Frings, Wolfgang
TI  - Analyzing HPC Monitoring Data With a View Towards Efficient Resource Utilization
JO  - 2643-3001
PB  - IEEE
M1  - FZJ-2024-05813
SP  - 170-181
PY  - 2024
N1  - The data used for this study are available at: https://doi.org/10.26165/JUELICH-DATA/BDFBPQ 979-8-3503-5616-8/24/$31.00 © 2024 IEEE.  Personal use of this material is permitted.  Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
AB  - Compute nodes in modern HPC systems are growing in size and their hardware has become ever more diverse. Still, many HPC centers allocate the resources of full nodes exclusively to avoid contention, despite the associated risk of underutilization. This paper describes a thorough resource utilization study of CPU and GPU compute and memory capacity, and interconnect bandwidth on JUWELS, a mature leadership-class modular supercomputer, with the aim of identifying opportunities for improving utilization through advanced scheduling and node sharing. Separate analysis of CPU-only and GPU-accelerated nodes finds that CPU compute usage is already close to optimal for the CPU-only nodes, whereas there is plenty of scope for co-scheduling CPU-based jobs on GPU-accelerated nodes. Memory capacity and node-level interconnect bandwidth are sufficient to provision co-scheduled jobs. We analyze multiple one-month datasets to validate robustness of conclusions over time and compare with previous studies on other systems to establish generalizability of results.
T2  - 2024 IEEE 36th International Symposium on Computer Architecture and High Performance Computing
CY  - 13 Nov 2024 - 15 Nov 2024, Hilo, HI (USA)
Y2  - 13 Nov 2024 - 15 Nov 2024
M2  - Hilo, HI, USA
LB  - PUB:(DE-HGF)16 ; PUB:(DE-HGF)8 ; PUB:(DE-HGF)7
DO  - DOI:10.1109/SBAC-PAD63648.2024.00023
UR  - https://juser.fz-juelich.de/record/1031786
ER  -