Journal Article FZJ-2018-07146

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Rigorous Neural Network Simulations: A Model Substantiation Methodology for Increasing the Correctness of Simulation Results in the Absence of Experimental Validation Data

 ;  ;  ;  ;

2018
Frontiers Research Foundation Lausanne

Frontiers in neuroinformatics 12, 81 () [10.3389/fninf.2018.00081] special issue: "Reproducibility and Rigour in Computational Neuroscience"

This record in other databases:      

Please use a persistent id in citations:   doi:

Abstract: The reproduction and replication of scientific results is an indispensable aspect of good scientific practice, enabling previous studies to be built upon and increasing our level of confidence in them. However, reproducibility and replicability are not sufficient: an incorrect result will be accurately reproduced if the same incorrect methods are used. For the field of simulations of complex neural networks, the causes of incorrect results vary from insufficient model implementations and data analysis methods, deficiencies in workmanship (e.g., simulation planning, setup, and execution) to errors induced by hardware constraints (e.g., limitations in numerical precision). In order to build credibility, methods such as verification and validation have been developed, but they are not yet well-established in the field of neural network modeling and simulation, partly due to ambiguity concerning the terminology. In this manuscript, we propose a terminology for model verification and validation in the field of neural network modeling and simulation. We outline a rigorous workflow derived from model verification and validation methodologies for increasing model credibility when it is not possible to validate against experimental data. We compare a published minimal spiking network model capable of exhibiting the development of polychronous groups, to its reproduction on the SpiNNaker neuromorphic system, where we consider the dynamics of several selected network states. As a result, by following a formalized process, we show that numerical accuracy is critically important, and even small deviations in the dynamics of individual neurons are expressed in the dynamics at network level.

Classification:

Contributing Institute(s):
  1. Jülich Supercomputing Center (JSC)
  2. Computational and Systems Neuroscience (INM-6)
  3. Theoretical Neuroscience (IAS-6)
  4. Jara-Institut Brain structure-function relationships (INM-10)
Research Program(s):
  1. 574 - Theory, modelling and simulation (POF3-574) (POF3-574)
  2. 511 - Computational Science and Mathematical Methods (POF3-511) (POF3-511)
  3. HBP SGA1 - Human Brain Project Specific Grant Agreement 1 (720270) (720270)
  4. HBP SGA2 - Human Brain Project Specific Grant Agreement 2 (785907) (785907)
  5. SLNS - SimLab Neuroscience (Helmholtz-SLNS) (Helmholtz-SLNS)

Appears in the scientific report 2018
Database coverage:
Medline ; Creative Commons Attribution CC BY 4.0 ; DOAJ ; OpenAccess ; BIOSIS Previews ; Clarivate Analytics Master Journal List ; DOAJ Seal ; IF < 5 ; JCR ; PubMed Central ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Institute Collections > INM > INM-10
Institute Collections > IAS > IAS-6
Institute Collections > INM > INM-6
Workflow collections > Public records
Workflow collections > Publication Charges
Institute Collections > JSC
Publications database
Open Access

 Record created 2018-12-06, last modified 2024-03-13