Poster (After Call) FZJ-2026-05292

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Empowering Neuroscience Research with Portable HPC Containers

 ;  ;  ;  ;

2026

Nest Conference 2026, FZJFZJ, Germany, 16 Jun 2026 - 17 Jun 20262026-06-162026-06-17 () [10.34734/FZJ-2026-05292]

This record in other databases:  

Please use a persistent id in citations: doi:

Abstract: Reproducibility in computational neuroscience depends not only on complex simulation packages but critically on their entire dependency graph. NEST 3.9 — a widely used neural network simulator — carries 72 transitive dependencies, including OpenMPI, Boost, jemalloc, and Python. Deploying such workflows across HPC infrastructures is hindered by site-specific dependencies, complex build environments, heterogeneous operating systems, and microarchitecture-specific compiler optimisations.<br><br>The EBRAINS Software Distribution (ESD) addresses the primary pain point for HPC users: managing conflicting dependency graphs and interoperability challenges when combining NEST with other tools in a single, verified environment. While the ESD facilitates this by rigidly tracking dependencies via Spack, synchronising identical environments from ESD cloud deployments to specific HPC host machines remains challenging, frequently resulting in dependency hell.<br><br>We present a zero-install approach using portable, HPC-enabled Apptainer container images that incorporate these complex interdependencies. Achieving near-bare-metal performance requires explicitly addressing HPC-specific hardware interfaces: large-scale distributed simulators such as NEST require the containerised MPI runtime to interface with the host network fabric, process manager, and job scheduler simultaneously. We employ a PMIx-based strategy, encapsulating OpenMPI-5.x, UCX, verbs, and a PMIx client within the container. At runtime, the containerised PMIx client connects to the host-side PMIx server exposed by SLURM, bridging container MPI to the host scheduler.<br>To support heterogeneous microarchitectures (AVX2 and AVX-512 across Intel/AMD nodes), we use QEMU user-mode emulation within Apptainer to produce architecture-optimised builds. Performance is validated through microbenchmarks and NEST scaling tests. This work will be a core aspect of the ESD’s move toward streaming containers via CernVM-FS for on-demand deployment across HPC infrastructures.


Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
  2. Computational and Systems Neuroscience (IAS-6)
Research Program(s):
  1. 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) (POF4-511)
  2. 5232 - Computational Principles (POF4-523) (POF4-523)
  3. 5231 - Neuroscientific Foundations (POF4-523) (POF4-523)
  4. 5235 - Digitization of Neuroscience and User-Community Building (POF4-523) (POF4-523)
  5. 5234 - Emerging NC Architectures (POF4-523) (POF4-523)
  6. EBRAINS 2.0 - EBRAINS 2.0: A Research Infrastructure to Advance Neuroscience and Brain Health (101147319) (101147319)
  7. SDLN - Simulation and Data Lab Neuroscience (Helmholtz-SDLN) (Helmholtz-SDLN)
  8. JL SMHB - Joint Lab Supercomputing and Modeling for the Human Brain (JL SMHB-2021-2027) (JL SMHB-2021-2027)
  9. HBP SGA3 - Human Brain Project Specific Grant Agreement 3 (945539) (945539)

Appears in the scientific report 2026
Database coverage:
OpenAccess
Click to display QR Code for this record

The record appears in these collections:
Document types > Presentations > Poster
Institute Collections > IAS > IAS-6
Workflow collections > Public records
Institute Collections > JSC
Publications database
Open Access

 Record created 2026-10-30, last modified 2026-11-05


OpenAccess:
Download fulltext PDF
External link:
Download fulltextFulltext
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)