TY  - EJOUR
AU  - Pronold, Jari
AU  - Jordan, Jakob
AU  - Wylie, Brian J. N.
AU  - Kitayama, Itaru
AU  - Diesmann, Markus
AU  - Kunkel, Susanne
TI  - Routing brain traffic through the von Neumann bottleneck: Efficient cache usage in spiking neural network simulation code on general purpose computers
PB  - arXiv
M1  - FZJ-2022-01560
PY  - 2021
AB  - Simulation is a third pillar next to experiment and theory in the study of complex dynamic systems such as biological neural networks. Contemporary brain-scale networks correspond to directed graphs of a few million nodes, each with an in-degree and out-degree of several thousands of edges, where nodes and edges correspond to the fundamental biological units, neurons and synapses, respectively. When considering a random graph, each node's edges are distributed across thousands of parallel processes. The activity in neuronal networks is also sparse. Each neuron occasionally transmits a brief signal, called spike, via its outgoing synapses to the corresponding target neurons. This spatial and temporal sparsity represents an inherent bottleneck for simulations on conventional computers: Fundamentally irregular memory-access patterns cause poor cache utilization. Using an established neuronal network simulation code as a reference implementation, we investigate how common techniques to recover cache performance such as software-induced prefetching and software pipelining can benefit a real-world application. The algorithmic changes reduce simulation time by up to 50%. The study exemplifies that many-core systems assigned with an intrinsically parallel computational problem can overcome the von Neumann bottleneck of conventional computer architectures.
KW  - Distributed, Parallel, and Cluster Computing (cs.DC) (Other)
KW  - FOS: Computer and information sciences (Other)
LB  - PUB:(DE-HGF)25
DO  - DOI:10.48550/ARXIV.2109.12855
UR  - https://juser.fz-juelich.de/record/906624
ER  -