TY  - CONF
AU  - Caspart, René
AU  - Speck, Robert
AU  - Mesiti, Michele
TI  - RSEHPC@ISC25: Tools and Techniques for Continuous Integration and Benchmarking
VL  - 16091
CY  - Cham
PB  - Springer Nature Switzerland
M1  - FZJ-2025-05251
SN  - 978-3-032-07611-3 (print)
T2  - Lecture Notes in Computer Science
SP  - 683 - 692
PY  - 2026
AB  - This summary paper presents the outcomes of the RSEHPC workshop at ISC25, which convened experts from the Research Software Engineering and High-Performance Computing communities to examine the integration of Continuous Integration and Continuous Benchmarking (CI/CB) throughout the HPC system life cycle. Through keynote and lightning talks as well as through lively discussions, participants explored the use of CI/CB from system design and procurement to deployment and production use. The paper highlights three case studies: KIT’s CI/CB services in production for flexible HPC benchmarking; JSC’s deployment of exaCB for system-wide benchmarking during the JUPITER exascale system preparations; and RIKEN R-CCS’s integration of CI/CB in the early design phase of the FugakuNEXT project. User perspectives from software developers of projects like OpenFOAM, PIConGPU, and libNEGF underscore both the growing importance and the practical challenges of implementing CI/CB in diverse and complex HPC environments. A recurring theme is the tension between the need for customized solutions and the drawbacks of fragmentation, which hinder reproducibility, portability, and collaboration. The paper concludes with a call to action for the HPC community to establish common standards for CI/CB workflows and data formats. By making benchmarking practices more FAIR (Findable, Accessible, Interoperable, Reproducible), the community can enhance software sustainability and operational excellence in HPC ecosystems.
T2  - ISC High Performance 2025
CY  - 22 Jun 2025 - 26 Jun 2025, Hamburg (Germany)
Y2  - 22 Jun 2025 - 26 Jun 2025
M2  - Hamburg, Germany
LB  - PUB:(DE-HGF)8 ; PUB:(DE-HGF)7
DO  - DOI:10.1007/978-3-032-07612-0_54
UR  - https://juser.fz-juelich.de/record/1049168
ER  -