guest ::
| Home > Publications database > JUBE: An Environment for Systematic Benchmarking and Scientific Workflows |
| Home > Publications database > JUBE: An Environment for Systematic Benchmarking and Scientific Workflows |
| Conference Presentation (Invited) | FZJ-2026-02470 |
2026
This record in other databases:
Please use a persistent id in citations: doi:10.34734/FZJ-2026-02470
Abstract: A key aspect of developing research software is testing the installation and the expected results on various configurations, as well as benchmarking the performance preferably continuously. This applies especially to software that targets high-performance computing (HPC) installations around Europe and the world. For these applications performance, scalability, and efficiency are key metrics that need to be monitored and compared among systems. Due to the complexity of these technical installations, individual scripts written for a specific system lack portability, reusability and reproducibility.These challenges were addressed by the development of the Jülich Benchmarking Environment (JUBE) at the Jülich Supercomputing Centre (JSC). JUBE is a generic and lightweight framework that automates the systematic execution, monitoring, and analysis of applications. It is a free, open-source software implemented in Python that operates on a "declarative configuration" paradigm, where experiments are defined in human-readable YAML/XML files, automating script generation, job submission, and result analysis. Due to its standardized configuration format, it simplifies collaboration and usability of research software. JUBE integrates seamlessly with CI/CD pipelines, enabling automated regression testing, performance tracking, and benchmarking as part of HPC software development workflows.The entry barrier of JUBE is relatively low as it builds upon basic knowledge of the Linux shell and either XML or YAML, and an extensive documentation including tutorials and advanced examples is available. Offering a high degree of flexibility, JUBE may be used in every phase of the HPC software development pipeline. Example use cases comprise standard benchmarks to track a project's development in terms of performance, or systematic studies to explore parameter combinations---including orchestrating scaling experiments, which has already been shown to streamline the application process for HPC compute resources. JUBE has been previously used to successfully automate a large variety of scientific codes and standard HPC benchmarks, with configurations available open-source. The software can be easily installed, with existing configurations also available for the software managers EasyBuild and Spack. Further projects have been built on top of JUBE.In conclusion, JUBE is a well-established software, which has already been used in several national and international projects and on numerous and diverse HPC systems. Given its broad scope and range of applications, JUBE is likely to be of interest to those working in the HPC software sector.This presentation will provide an overview of JUBE, covering its core principles, current status, and future development roadmap. It will demonstrate how JUBE and EasyBuild/EESSI can be used together for mutual benefit. Several illustrative use cases will also be presented to demonstrate JUBE's practical applications. These include benchmarking as part of the procurement of JUPITER - Europe’s first exascale supercomputer - and providing continuous insight into HPC system health by regularly executing applications and graphically presenting their results.
|
The record appears in these collections: |
PDF
Fulltext