000858244 001__ 858244
000858244 005__ 20240313103111.0
000858244 0247_ $$2Handle$$a2128/21178
000858244 037__ $$aFZJ-2018-07144
000858244 041__ $$aEnglish
000858244 1001_ $$0P:(DE-Juel1)171572$$aGutzen, Robin$$b0$$eCorresponding author$$ufzj
000858244 1112_ $$aData Science Summer School$$cParis$$d2017-08-28 - 2017-09-01$$gDS3$$wFrance
000858244 245__ $$aValidation Methods for Neural Network Simulations
000858244 260__ $$c2017
000858244 3367_ $$033$$2EndNote$$aConference Paper
000858244 3367_ $$2BibTeX$$aINPROCEEDINGS
000858244 3367_ $$2DRIVER$$aconferenceObject
000858244 3367_ $$2ORCID$$aCONFERENCE_POSTER
000858244 3367_ $$2DataCite$$aOutput Types/Conference Poster
000858244 3367_ $$0PUB:(DE-HGF)24$$2PUB:(DE-HGF)$$aPoster$$bposter$$mposter$$s1547555725_18954$$xOther
000858244 520__ $$aNeuroscience as an evolving field is in the quite rare situation that the amount of models and theories about the various functionalities of the brain is contrasted against a constantly growing body of experimental evidence. In this state of research, the role of neural network simulations to link theory and data gains importance. There is a large variety of simulators and simulator frameworks (e.g., NEST, BRIAN, NEURON, SpikeNET) which may differ strongly in their internal models used for of computation and the implications that come with it. Hence there is a high demand for a thorough understanding of these simulation engines that are used to generate simulated network activity data, in particular with respect to their accuracy. For a proper evaluation of simulations, new tools have to be developed in order to perform such validations, in an accessible and readily reproducible fashion.However, the comparison can not simply be done in a spike-to-spike manner for a number of reasons: neuronal spiking isstochastic, and competing implementations of algorithms or differences in the numerical processing may cause deviations in the precise output of the simulations. Instead, the simulations have to be evaluated in a statistical sense and yield quantifiable measures to characterize significant identity or difference of model and experiment or different models. Thus, we deal with the question of how to properly validate neural network simulations?As a test case, we chose the validation of a neuronal network simulated on the neuromorphic hardware SpiNNaker againstthe same simulation carried out using the NEST simulator software as reference [1]. The NEST simulator is an open source software project developed by the NEST initiative (http://www.nest-initiative.org) and features exact numerical integration of the dynamics. The SpiNNaker system, located in Manchester, UK, is a neuromorphic architecture consisting of millions of cores which can perform efficient network simulations on a hardware level. Since this operation mode is inherently different from conventional software simulations and has some constrictions regarding, e.g., the fine temporal resolution of spikes, the validity of such simulations with respect to NEST is not immediately given. The starting point of the validation of SpiNNaker with NEST are the results of a model simulation of the canonical microcircuit model [2] which was performed on both platforms. The results are given in form of recorded spiking activity. We concentrate on validating the results by comparing measures describing the single neuron statistics (firing rate, coefficient of variation of the interspike intervals (CV)) as well as the correlation structure in the simulated network as measured by the pairwise correlation coefficients between all spike trains. In a first approach, we chose to compare the outcomes in form of the distributions of the measures and tested the suitability of a variety of statistical two sample tests (Kolmogorov-Smirnov-Distance, Mann-Whitney-U, and Kullback-Leibler-Divergence) using the network simulations and complemented by stochastic spike train simulations. However, such an analysis of correlation coefficients alone is not able to give insights about which neurons are involved in the correlations and if there are higher order correlations present. Therefore, we assess the correlation structure using an eigenvaluedecomposition of the correlation matrix. We present an approach to use the eigenvalue decomposition to reorder the neurons with respect to their correlation strength to identify groups of highly correlated neurons.The goal of the development and pooling of these validation methods is to provide a flexible toolbox which is not tailored towards one specific application but may be used in a broad group of validation cases. In future work, we aim at describing the dependence of the validation approaches on the type of the network simulation, the number of recorded neurons, the simulation duration, the features of the model, the reference mode, and the scientific question behind the analysis.References:[1] Senk, Johanna, et al. ”A Collaborative Simulation-Analysis Workflow for Computational Neuroscience Using HPC.” JülichAachen Research Alliance (JARA) High-Performance Computing Symposium. Springer, Cham, 2016. [2] Potjans, Tobias C., and Markus Diesmann. ”The cell-type specific cortical microcircuit: relating structure and activity in a full-scale spiking network model.” Cerebral Cortex 24.3 (2014): 785-806.
000858244 536__ $$0G:(DE-HGF)POF3-574$$a574 - Theory, modelling and simulation (POF3-574)$$cPOF3-574$$fPOF III$$x0
000858244 536__ $$0G:(DE-HGF)POF3-571$$a571 - Connectivity and Activity (POF3-571)$$cPOF3-571$$fPOF III$$x1
000858244 7001_ $$0P:(DE-Juel1)144168$$aGrün, Sonja$$b1$$ufzj
000858244 7001_ $$0P:(DE-Juel1)144807$$aDenker, Michael$$b2$$ufzj
000858244 8564_ $$uhttps://juser.fz-juelich.de/record/858244/files/Gutzen_validation_methods.pdf$$yOpenAccess
000858244 8564_ $$uhttps://juser.fz-juelich.de/record/858244/files/Gutzen_validation_methods.pdf?subformat=pdfa$$xpdfa$$yOpenAccess
000858244 909CO $$ooai:juser.fz-juelich.de:858244$$pdriver$$pVDB$$popen_access$$popenaire
000858244 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)171572$$aForschungszentrum Jülich$$b0$$kFZJ
000858244 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)144168$$aForschungszentrum Jülich$$b1$$kFZJ
000858244 9101_ $$0I:(DE-588b)5008462-8$$6P:(DE-Juel1)144807$$aForschungszentrum Jülich$$b2$$kFZJ
000858244 9131_ $$0G:(DE-HGF)POF3-574$$1G:(DE-HGF)POF3-570$$2G:(DE-HGF)POF3-500$$3G:(DE-HGF)POF3$$4G:(DE-HGF)POF$$aDE-HGF$$bKey Technologies$$lDecoding the Human Brain$$vTheory, modelling and simulation$$x0
000858244 9131_ $$0G:(DE-HGF)POF3-571$$1G:(DE-HGF)POF3-570$$2G:(DE-HGF)POF3-500$$3G:(DE-HGF)POF3$$4G:(DE-HGF)POF$$aDE-HGF$$bKey Technologies$$lDecoding the Human Brain$$vConnectivity and Activity$$x1
000858244 9141_ $$y2018
000858244 915__ $$0StatID:(DE-HGF)0510$$2StatID$$aOpenAccess
000858244 9201_ $$0I:(DE-Juel1)INM-6-20090406$$kINM-6$$lComputational and Systems Neuroscience$$x0
000858244 9201_ $$0I:(DE-Juel1)INM-10-20170113$$kINM-10$$lJara-Institut Brain structure-function relationships$$x1
000858244 9201_ $$0I:(DE-Juel1)IAS-6-20130828$$kIAS-6$$lTheoretical Neuroscience$$x2
000858244 9801_ $$aFullTexts
000858244 980__ $$aposter
000858244 980__ $$aVDB
000858244 980__ $$aUNRESTRICTED
000858244 980__ $$aI:(DE-Juel1)INM-6-20090406
000858244 980__ $$aI:(DE-Juel1)INM-10-20170113
000858244 980__ $$aI:(DE-Juel1)IAS-6-20130828
000858244 981__ $$aI:(DE-Juel1)IAS-6-20130828