Journal Article

FZJ-2022-02910

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Routing brain traffic through the von Neumann bottleneck: Efficient cache usage in spiking neural network simulation code on general purpose computers

Pronold, J. (Corresponding author)FZJ* ; Jordan, J. ; Wylie, B. J. N.FZJ* ; Kitayama, I.FZJ* ; Diesmann, M.FZJ* ; Kunkel, S. (Corresponding author)FZJ*

2022
North-Holland, Elsevier Science Amsterdam [u.a.]

This record in other databases:  

Please use a persistent id in citations: http://hdl.handle.net/2128/31621  doi:10.1016/j.parco.2022.102952

Abstract: Simulation is a third pillar next to experiment and theory in the study of complex dynamic systems such as biological neural networks. Contemporary brain-scale networks correspond to directed random graphs of a few million nodes, each with an in-degree and out-degree of several thousands of edges, where nodes and edges correspond to the fundamental biological units, neurons and synapses, respectively. The activity in neuronal networks is also sparse. Each neuron occasionally transmits a brief signal, called spike, via its outgoing synapses to the corresponding target neurons. In distributed computing these targets are scattered across thousands of parallel processes. The spatial and temporal sparsity represents an inherent bottleneck for simulations on conventional computers: irregular memory-access patterns cause poor cache utilization. Using an established neuronal network simulation code as a reference implementation, we investigate how common techniques to recover cache performance such as software-induced prefetching and software pipelining can benefit a real-world application. The algorithmic changes reduce simulation time by up to 50%. The study exemplifies that many-core systems assigned with an intrinsically parallel computational problem can alleviate the von Neumann bottleneck of conventional computer architectures.

---

Contributing Institute(s):

1. Computational and Systems Neuroscience (INM-6)
2. Theoretical Neuroscience (IAS-6)
3. Jara-Institut Brain structure-function relationships (INM-10)

Research Program(s):

1. 5234 - Emerging NC Architectures (POF4-523) (POF4-523)
2. HBP SGA2 - Human Brain Project Specific Grant Agreement 2 (785907) (785907)
3. HBP SGA3 - Human Brain Project Specific Grant Agreement 3 (945539) (945539)
4. DEEP-EST - DEEP - Extreme Scale Technologies (754304) (754304)
5. ACA - Advanced Computing Architectures (SO-092) (SO-092)
6. GRK 2416:  MultiSenses-MultiScales: Novel approaches to decipher neural processing in multisensory integration (368482240) (368482240)
7. Open-Access-Publikationskosten Forschungszentrum Jülich (OAPKFZJ) (491111487) (491111487)
8. PhD no Grant - Doktorand ohne besondere Förderung (PHD-NO-GRANT-20170405) (PHD-NO-GRANT-20170405)
9. BTN-Peta - The Next-Generation Integrated Simulation of Living Matter (BTN-Peta-2008-2012) (BTN-Peta-2008-2012)
10. Brain-Scale Simulations (jinb33_20220812) (jinb33_20220812)
11. ATMLPP - ATML Parallel Performance (ATMLPP) (ATMLPP)

Appears in the scientific report 2022

---

Database coverage:
; ; ; Clarivate Analytics Master Journal List ; Current Contents - Engineering, Computing and Technology ; Ebsco Academic Search ; Essential Science Indicators ; IF < 5 ; JCR ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection

---