| Home > Workflow collections > Publication Charges > A Modular Workflow for Performance Benchmarking of Neuronal Network Simulations > print |
| 001 | 906899 | ||
| 005 | 20240313103131.0 | ||
| 024 | 7 | _ | |a 10.3389/fninf.2022.837549 |2 doi |
| 024 | 7 | _ | |a 2128/31404 |2 Handle |
| 024 | 7 | _ | |a 35645755 |2 pmid |
| 024 | 7 | _ | |a WOS:000804029700001 |2 WOS |
| 037 | _ | _ | |a FZJ-2022-01754 |
| 082 | _ | _ | |a 610 |
| 100 | 1 | _ | |a Albers, Jasper |0 P:(DE-Juel1)180539 |b 0 |e Corresponding author |
| 245 | _ | _ | |a A Modular Workflow for Performance Benchmarking of Neuronal Network Simulations |
| 260 | _ | _ | |a Lausanne |c 2022 |b Frontiers Research Foundation |
| 336 | 7 | _ | |a article |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Journal article |2 DataCite |
| 336 | 7 | _ | |a Journal Article |b journal |m journal |0 PUB:(DE-HGF)16 |s 1656578438_22042 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a ARTICLE |2 BibTeX |
| 336 | 7 | _ | |a JOURNAL_ARTICLE |2 ORCID |
| 336 | 7 | _ | |a Journal Article |0 0 |2 EndNote |
| 500 | _ | _ | |a 21 pages, 8 figures, 1 listing |
| 520 | _ | _ | |a Modern computational neuroscience strives to develop complex network models to explain dynamics and function of brains in health and disease. This process goes hand in hand with advancements in the theory of neuronal networks and increasing availability of detailed anatomical data on brain connectivity. Large-scale models that study interactions between multiple brain areas with intricate connectivity and investigate phenomena on long time scales such as system-level learning require progress in simulation speed. The corresponding development of state-of-the-art simulation engines relies on information provided by benchmark simulations which assess the time-to-solution for scientifically relevant, complementary network models using various combinations of hardware and software revisions. However, maintaining comparability of benchmark results is difficult due to a lack of standardized specifications for measuring the scaling performance of simulators on high-performance computing (HPC) systems. Motivated by the challenging complexity of benchmarking, we define a generic workflow that decomposes the endeavor into unique segments consisting of separate modules. As a reference implementation for the conceptual workflow, we develop beNNch: an open-source software framework for the configuration, execution, and analysis of benchmarks for neuronal network simulations. The framework records benchmarking data and metadata in a unified way to foster reproducibility. For illustration, we measure the performance of various versions of the NEST simulator across network models with different levels of complexity on a contemporary HPC system, demonstrating how performance bottlenecks can be identified, ultimately guiding the development toward more efficient simulation technology. |
| 536 | _ | _ | |a 5234 - Emerging NC Architectures (POF4-523) |0 G:(DE-HGF)POF4-5234 |c POF4-523 |f POF IV |x 0 |
| 536 | _ | _ | |a HBP SGA3 - Human Brain Project Specific Grant Agreement 3 (945539) |0 G:(EU-Grant)945539 |c 945539 |f H2020-SGA-FETFLAG-HBP-2019 |x 1 |
| 536 | _ | _ | |a DEEP-EST - DEEP - Extreme Scale Technologies (754304) |0 G:(EU-Grant)754304 |c 754304 |f H2020-FETHPC-2016 |x 2 |
| 536 | _ | _ | |a ACA - Advanced Computing Architectures (SO-092) |0 G:(DE-HGF)SO-092 |c SO-092 |x 3 |
| 536 | _ | _ | |a JL SMHB - Joint Lab Supercomputing and Modeling for the Human Brain (JL SMHB-2021-2027) |0 G:(DE-Juel1)JL SMHB-2021-2027 |c JL SMHB-2021-2027 |x 4 |
| 536 | _ | _ | |a GRK 2416: MultiSenses-MultiScales: Novel approaches to decipher neural processing in multisensory integration (368482240) |0 G:(GEPRIS)368482240 |c 368482240 |x 5 |
| 536 | _ | _ | |a Open-Access-Publikationskosten Forschungszentrum Jülich (OAPKFZJ) (491111487) |0 G:(GEPRIS)491111487 |c 491111487 |x 6 |
| 536 | _ | _ | |a MetaMoSim - Generic metadata management for reproducible high-performance-computing simulation workflows - MetaMoSim (ZT-I-PF-3-026) |0 G:(DE-Juel-1)ZT-I-PF-3-026 |c ZT-I-PF-3-026 |x 7 |
| 536 | _ | _ | |a PhD no Grant - Doktorand ohne besondere Förderung (PHD-NO-GRANT-20170405) |0 G:(DE-Juel1)PHD-NO-GRANT-20170405 |c PHD-NO-GRANT-20170405 |x 8 |
| 588 | _ | _ | |a Dataset connected to CrossRef, Journals: juser.fz-juelich.de |
| 700 | 1 | _ | |a Pronold, Jari |0 P:(DE-Juel1)165321 |b 1 |
| 700 | 1 | _ | |a Kurth, Anno |0 P:(DE-Juel1)176776 |b 2 |
| 700 | 1 | _ | |a Vennemo, Stine Brekke |0 P:(DE-HGF)0 |b 3 |
| 700 | 1 | _ | |a Mood, Kaveh Haghighi |0 P:(DE-HGF)0 |b 4 |
| 700 | 1 | _ | |a Patronis, Alexander |0 P:(DE-Juel1)179111 |b 5 |
| 700 | 1 | _ | |a Terhorst, Dennis |0 P:(DE-Juel1)169778 |b 6 |
| 700 | 1 | _ | |a Jordan, Jakob |0 P:(DE-HGF)0 |b 7 |
| 700 | 1 | _ | |a Kunkel, Susanne |0 P:(DE-HGF)0 |b 8 |
| 700 | 1 | _ | |a Tetzlaff, Tom |0 P:(DE-Juel1)145211 |b 9 |
| 700 | 1 | _ | |a Diesmann, Markus |0 P:(DE-Juel1)144174 |b 10 |
| 700 | 1 | _ | |a Senk, Johanna |0 P:(DE-Juel1)162130 |b 11 |
| 773 | _ | _ | |a 10.3389/fninf.2022.837549 |g Vol. 16, p. 837549 |0 PERI:(DE-600)2452979-5 |p 837549 |t Frontiers in neuroinformatics |v 16 |y 2022 |x 1662-5196 |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/906899/files/fninf-16-837549.pdf |y OpenAccess |
| 909 | C | O | |o oai:juser.fz-juelich.de:906899 |p openaire |p open_access |p OpenAPC |p driver |p VDB |p ec_fundedresources |p openCost |p dnbdelivery |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)180539 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 1 |6 P:(DE-Juel1)165321 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)176776 |
| 910 | 1 | _ | |a External Institute |0 I:(DE-HGF)0 |k Extern |b 3 |6 P:(DE-HGF)0 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 4 |6 P:(DE-HGF)0 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 5 |6 P:(DE-Juel1)179111 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 6 |6 P:(DE-Juel1)169778 |
| 910 | 1 | _ | |a External Institute |0 I:(DE-HGF)0 |k Extern |b 7 |6 P:(DE-HGF)0 |
| 910 | 1 | _ | |a External Institute |0 I:(DE-HGF)0 |k Extern |b 8 |6 P:(DE-HGF)0 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 9 |6 P:(DE-Juel1)145211 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 10 |6 P:(DE-Juel1)144174 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 11 |6 P:(DE-Juel1)162130 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Natural, Artificial and Cognitive Information Processing |1 G:(DE-HGF)POF4-520 |0 G:(DE-HGF)POF4-523 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Neuromorphic Computing and Network Dynamics |9 G:(DE-HGF)POF4-5234 |x 0 |
| 914 | 1 | _ | |y 2022 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0160 |2 StatID |b Essential Science Indicators |d 2021-05-04 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1190 |2 StatID |b Biological Abstracts |d 2021-05-04 |
| 915 | _ | _ | |a Creative Commons Attribution CC BY 4.0 |0 LIC:(DE-HGF)CCBY4 |2 HGFVOC |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 915 | _ | _ | |a Fees |0 StatID:(DE-HGF)0700 |2 StatID |d 2021-05-04 |
| 915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0113 |2 StatID |b Science Citation Index Expanded |d 2021-05-04 |
| 915 | _ | _ | |a Article Processing Charges |0 StatID:(DE-HGF)0561 |2 StatID |d 2021-05-04 |
| 915 | _ | _ | |a JCR |0 StatID:(DE-HGF)0100 |2 StatID |b FRONT NEUROINFORM : 2021 |d 2022-11-24 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |d 2022-11-24 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0300 |2 StatID |b Medline |d 2022-11-24 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0501 |2 StatID |b DOAJ Seal |d 2021-05-11T13:08:14Z |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0500 |2 StatID |b DOAJ |d 2021-05-11T13:08:14Z |
| 915 | _ | _ | |a Peer Review |0 StatID:(DE-HGF)0030 |2 StatID |b DOAJ : Blind peer review |d 2021-05-11T13:08:14Z |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Clarivate Analytics Master Journal List |d 2022-11-24 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |d 2022-11-24 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1050 |2 StatID |b BIOSIS Previews |d 2022-11-24 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1110 |2 StatID |b Current Contents - Clinical Medicine |d 2022-11-24 |
| 915 | _ | _ | |a IF < 5 |0 StatID:(DE-HGF)9900 |2 StatID |d 2022-11-24 |
| 915 | p | c | |a APC keys set |2 APC |0 PC:(DE-HGF)0000 |
| 915 | p | c | |a Local Funding |2 APC |0 PC:(DE-HGF)0001 |
| 915 | p | c | |a DFG OA Publikationskosten |2 APC |0 PC:(DE-HGF)0002 |
| 915 | p | c | |a DOAJ Journal |2 APC |0 PC:(DE-HGF)0003 |
| 920 | 1 | _ | |0 I:(DE-Juel1)INM-10-20170113 |k INM-10 |l Jara-Institut Brain structure-function relationships |x 0 |
| 920 | 1 | _ | |0 I:(DE-Juel1)IAS-6-20130828 |k IAS-6 |l Theoretical Neuroscience |x 1 |
| 920 | 1 | _ | |0 I:(DE-Juel1)INM-6-20090406 |k INM-6 |l Computational and Systems Neuroscience |x 2 |
| 980 | 1 | _ | |a APC |
| 980 | 1 | _ | |a FullTexts |
| 980 | _ | _ | |a journal |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a I:(DE-Juel1)INM-10-20170113 |
| 980 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
| 980 | _ | _ | |a I:(DE-Juel1)INM-6-20090406 |
| 980 | _ | _ | |a APC |
| 980 | _ | _ | |a UNRESTRICTED |
| 981 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|