Journal Article FZJ-2023-04142

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Sequence learning in a spiking neuronal network with memristive synapses

 ;  ;  ;  ;  ;

2023
IOP Publishing Ltd.

Neuromorphic computing and engineering 3, 034014 () [10.1088/2634-4386/acf1c4]

This record in other databases:  

Please use a persistent id in citations: doi:  doi:

Abstract: Brain-inspired computing proposes a set of algorithmic principles that hold promise for advancing artificial intelligence. They endow systems with self learning capabilities, efficient energy usage, and high storage capacity. A core concept that lies at the heart of brain computation is sequence learning and prediction. This form of computation is essential for almost all our daily tasks such as movement generation, perception, and language. Understanding how the brain performs such a computation is not only important to advance neuroscience, but also to pave the way to new technological brain-inspired applications. A previously developed spiking neural network implementation of sequence prediction and recall learns complex, high-order sequences in an unsupervised manner by local, biologically inspired plasticity rules. An emerging type of hardware that may efficiently run this type of algorithm is neuromorphic hardware. It emulates the way the brain processes information and maps neurons and synapses directly into a physical substrate. Memristive devices have been identified as potential synaptic elements in neuromorphic hardware. In particular, redox-induced resistive random access memories (ReRAM) devices stand out at many aspects. They permit scalability, are energy efficient and fast, and can implement biological plasticity rules. In this work, we study the feasibility of using ReRAM devices as a replacement of the biological synapses in the sequence learning model. We implement and simulate the model including the ReRAM plasticity using the neural network simulator NEST. We investigate two types of ReRAM memristive devices: (i) a gradual, analog switching device, and (ii) an abrupt, binary switching device. We study the effect of different device properties on the performance characteristics of the sequence learning model, and demonstrate that, in contrast to many other artificial neural networks, this architecture is resilient with respect to changes in the on-off ratio and the conductance resolution, device variability, and device failure.

Classification:

Contributing Institute(s):
  1. Computational and Systems Neuroscience (INM-6)
  2. Computational and Systems Neuroscience (IAS-6)
  3. Jara-Institut Brain structure-function relationships (INM-10)
  4. Elektronische Materialien (PGI-7)
  5. JARA Institut Green IT (PGI-10)
  6. Neuromorphic Software Eco System (PGI-15)
Research Program(s):
  1. 574 - Theory, modelling and simulation (POF3-574) (POF3-574)
  2. 5232 - Computational Principles (POF4-523) (POF4-523)
  3. Advanced Computing Architectures (aca_20190115) (aca_20190115)
  4. HBP SGA2 - Human Brain Project Specific Grant Agreement 2 (785907) (785907)
  5. HBP SGA3 - Human Brain Project Specific Grant Agreement 3 (945539) (945539)
  6. BMBF 16ME0398K - Verbundprojekt: Neuro-inspirierte Technologien der künstlichen Intelligenz für die Elektronik der Zukunft - NEUROTEC II - (BMBF-16ME0398K) (BMBF-16ME0398K)
  7. BMBF 16ME0399 - Verbundprojekt: Neuro-inspirierte Technologien der künstlichen Intelligenz für die Elektronik der Zukunft - NEUROTEC II - (BMBF-16ME0399) (BMBF-16ME0399)
  8. DFG project 491111487 - Open-Access-Publikationskosten / 2022 - 2024 / Forschungszentrum Jülich (OAPKFZJ) (491111487) (491111487)

Appears in the scientific report 2023
Database coverage:
Creative Commons Attribution CC BY 4.0 ; DOAJ ; OpenAccess ; Article Processing Charges ; DOAJ Seal ; Fees
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Institute Collections > INM > INM-10
Institute Collections > IAS > IAS-6
Institute Collections > INM > INM-6
Institute Collections > PGI > PGI-15
Institute Collections > PGI > PGI-10
Institute Collections > PGI > PGI-7
Workflow collections > Public records
Publications database
Open Access

 Record created 2023-10-26, last modified 2024-05-02


OpenAccess:
Download fulltext PDF
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)