%0 Conference Paper
%A Caspart, René
%A Speck, Robert
%A Mesiti, Michele
%T RSEHPC@ISC25: Tools and Techniques for Continuous Integration and Benchmarking
%V 16091
%C Cham
%I Springer Nature Switzerland
%M FZJ-2025-05251
%@ 978-3-032-07611-3 (print)
%B Lecture Notes in Computer Science
%P 683 - 692
%D 2026
%< High Performance Computing
%X This summary paper presents the outcomes of the RSEHPC workshop at ISC25, which convened experts from the Research Software Engineering and High-Performance Computing communities to examine the integration of Continuous Integration and Continuous Benchmarking (CI/CB) throughout the HPC system life cycle. Through keynote and lightning talks as well as through lively discussions, participants explored the use of CI/CB from system design and procurement to deployment and production use. The paper highlights three case studies: KIT’s CI/CB services in production for flexible HPC benchmarking; JSC’s deployment of exaCB for system-wide benchmarking during the JUPITER exascale system preparations; and RIKEN R-CCS’s integration of CI/CB in the early design phase of the FugakuNEXT project. User perspectives from software developers of projects like OpenFOAM, PIConGPU, and libNEGF underscore both the growing importance and the practical challenges of implementing CI/CB in diverse and complex HPC environments. A recurring theme is the tension between the need for customized solutions and the drawbacks of fragmentation, which hinder reproducibility, portability, and collaboration. The paper concludes with a call to action for the HPC community to establish common standards for CI/CB workflows and data formats. By making benchmarking practices more FAIR (Findable, Accessible, Interoperable, Reproducible), the community can enhance software sustainability and operational excellence in HPC ecosystems.
%B ISC High Performance 2025
%C 22 Jun 2025 - 26 Jun 2025, Hamburg (Germany)
Y2 22 Jun 2025 - 26 Jun 2025
M2 Hamburg, Germany
%F PUB:(DE-HGF)8 ; PUB:(DE-HGF)7
%9 Contribution to a conference proceedingsContribution to a book
%R 10.1007/978-3-032-07612-0_54
%U https://juser.fz-juelich.de/record/1049168