Preprint FZJ-2026-01020

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Scalable Construction of Spiking Neural Networks using up to thousands of GPUs

 ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;

2025
arXiv

arXiv () [10.48550/arXiv.2512.09502]

This record in other databases:  

Please use a persistent id in citations: doi:

Abstract: Diverse scientific and engineering research areas deal with discrete, time-stamped changes in large systems of interacting delay differential equations. Simulating such complex systems at scale on high-performance computing clusters demands efficient management of communication and memory. Inspired by the human cerebral cortex — a sparsely connected network of $\mathcal{O}(10^{10})$ neurons, each forming $\mathcal{O}(10^{3})$--$\mathcal{O}(10^{4})$ synapses and communicating via short electrical pulses called spikes — we study the simulation of large-scale spiking neural networks for computational neuroscience research. This work presents a novel network construction method for multi-GPU clusters and upcoming exascale supercomputers using the Message Passing Interface (MPI), where each process builds its local connectivity and prepares the data structures for efficient spike exchange across the cluster during state propagation. We demonstrate scaling performance of two cortical models using point-to-point and collective communication, respectively.

Keyword(s): Distributed, Parallel, and Cluster Computing (cs.DC) ; Neural and Evolutionary Computing (cs.NE) ; Computational Physics (physics.comp-ph) ; Neurons and Cognition (q-bio.NC) ; FOS: Computer and information sciences ; FOS: Physical sciences ; FOS: Biological sciences


Contributing Institute(s):
  1. Computational and Systems Neuroscience (IAS-6)
  2. Jülich Supercomputing Center (JSC)
  3. Jara-Institut Brain structure-function relationships (INM-10)
Research Program(s):
  1. 5232 - Computational Principles (POF4-523) (POF4-523)
  2. 5234 - Emerging NC Architectures (POF4-523) (POF4-523)
  3. 5235 - Digitization of Neuroscience and User-Community Building (POF4-523) (POF4-523)
  4. HBP SGA3 - Human Brain Project Specific Grant Agreement 3 (945539) (945539)
  5. EBRAINS 2.0 - EBRAINS 2.0: A Research Infrastructure to Advance Neuroscience and Brain Health (101147319) (101147319)

Appears in the scientific report 2025
Click to display QR Code for this record

The record appears in these collections:
Institutssammlungen > INM > INM-10
Institutssammlungen > IAS > IAS-6
Dokumenttypen > Berichte > Vorabdrucke
Workflowsammlungen > Öffentliche Einträge
Institutssammlungen > JSC
Publikationsdatenbank

 Datensatz erzeugt am 2026-01-26, letzte Änderung am 2026-02-20


Restricted:
Volltext herunterladen PDF
Dieses Dokument bewerten:

Rate this document:
1
2
3
 
(Bisher nicht rezensiert)