guest ::
| Home > Workflow collections > Publication Charges > Unsupervised Learning and Clustered Connectivity Enhance Reinforcement Learning in Spiking Neural Networks > print |
| Home > Workflow collections > Publication Charges > Unsupervised Learning and Clustered Connectivity Enhance Reinforcement Learning in Spiking Neural Networks > print |
| 001 | 890994 | ||
| 005 | 20240313103111.0 | ||
| 024 | 7 | _ | |a 10.3389/fncom.2021.543872 |2 doi |
| 024 | 7 | _ | |a 2128/28017 |2 Handle |
| 024 | 7 | _ | |a altmetric:102089502 |2 altmetric |
| 024 | 7 | _ | |a 33746728 |2 pmid |
| 024 | 7 | _ | |a WOS:000629977000001 |2 WOS |
| 037 | _ | _ | |a FZJ-2021-01301 |
| 082 | _ | _ | |a 610 |
| 100 | 1 | _ | |a Weidel, Philipp |0 P:(DE-Juel1)162278 |b 0 |
| 245 | _ | _ | |a Unsupervised Learning and Clustered Connectivity Enhance Reinforcement Learning in Spiking Neural Networks |
| 260 | _ | _ | |a Lausanne |c 2021 |b Frontiers Research Foundation |
| 336 | 7 | _ | |a article |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Journal article |2 DataCite |
| 336 | 7 | _ | |a Journal Article |b journal |m journal |0 PUB:(DE-HGF)16 |s 1642001841_14168 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a ARTICLE |2 BibTeX |
| 336 | 7 | _ | |a JOURNAL_ARTICLE |2 ORCID |
| 336 | 7 | _ | |a Journal Article |0 0 |2 EndNote |
| 520 | _ | _ | |a Reinforcement learning is a paradigm that can account for how organisms learn to adapt their behavior in complex environments with sparse rewards. To partition an environment into discrete states, implementations in spiking neuronal networks typically rely on input architectures involving place cells or receptive fields specified ad hoc by the researcher. This is problematic as a model for how an organism can learn appropriate behavioral sequences in unknown environments, as it fails to account for the unsupervised and self-organized nature of the required representations. Additionally, this approach presupposes knowledge on the part of the researcher on how the environment should be partitioned and represented and scales poorly with the size or complexity of the environment. To address these issues and gain insights into how the brain generates its own task-relevant mappings, we propose a learning architecture that combines unsupervised learning on the input projections with biologically motivated clustered connectivity within the representation layer. This combination allows input features to be mapped to clusters; thus the network self-organizes to produce clearly distinguishable activity patterns that can serve as the basis for reinforcement learning on the output projections. On the basis of the MNIST and Mountain Car tasks, we show that our proposed model performs better than either a comparable unclustered network or a clustered network with static input projections. We conclude that the combination of unsupervised learning and clustered connectivity provides a generic representational substrate suitable for further computation. |
| 536 | _ | _ | |a 523 - Neuromorphic Computing and Network Dynamics (POF4-523) |0 G:(DE-HGF)POF4-523 |c POF4-523 |f POF IV |x 0 |
| 536 | _ | _ | |a 89574 - Theory, modelling and simulation (POF2-89574) |0 G:(DE-HGF)POF2-89574 |c POF2-89574 |f POF II T |x 1 |
| 536 | _ | _ | |a Functional Neural Architectures (jinm60_20190501) |0 G:(DE-Juel1)jinm60_20190501 |c jinm60_20190501 |f Functional Neural Architectures |x 2 |
| 536 | _ | _ | |a 5232 - Computational Principles (POF4-523) |0 G:(DE-HGF)POF4-5232 |c POF4-523 |f POF IV |x 3 |
| 588 | _ | _ | |a Dataset connected to CrossRef |
| 700 | 1 | _ | |a Duarte, Renato |0 P:(DE-Juel1)165640 |b 1 |e Corresponding author |u fzj |
| 700 | 1 | _ | |a Morrison, Abigail |0 P:(DE-Juel1)151166 |b 2 |u fzj |
| 773 | _ | _ | |a 10.3389/fncom.2021.543872 |g Vol. 15, p. 543872 |0 PERI:(DE-600)2452964-3 |p 543872 |t Frontiers in computational neuroscience |v 15 |y 2021 |x 1662-5188 |
| 856 | 4 | _ | |u https://juser.fz-juelich.de/record/890994/files/fncom-15-543872.pdf |y OpenAccess |
| 909 | C | O | |o oai:juser.fz-juelich.de:890994 |p openaire |p open_access |p OpenAPC |p driver |p VDB |p openCost |p dnbdelivery |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 1 |6 P:(DE-Juel1)165640 |
| 910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 2 |6 P:(DE-Juel1)151166 |
| 913 | 0 | _ | |a DE-HGF |b Programmungebundene Forschung |l ohne Programm |1 G:(DE-HGF)POF3-890 |0 G:(DE-HGF)POF2-89574 |3 G:(DE-HGF)POF3 |2 G:(DE-HGF)POF3-800 |4 G:(DE-HGF)POF |v Theory, modelling and simulation |x 0 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Natural, Artificial and Cognitive Information Processing |1 G:(DE-HGF)POF4-520 |0 G:(DE-HGF)POF4-523 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Neuromorphic Computing and Network Dynamics |x 0 |
| 913 | 1 | _ | |a DE-HGF |b Key Technologies |l Natural, Artificial and Cognitive Information Processing |1 G:(DE-HGF)POF4-520 |0 G:(DE-HGF)POF4-523 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Neuromorphic Computing and Network Dynamics |9 G:(DE-HGF)POF4-5232 |x 1 |
| 914 | 1 | _ | |y 2021 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0160 |2 StatID |b Essential Science Indicators |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1050 |2 StatID |b BIOSIS Previews |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1190 |2 StatID |b Biological Abstracts |d 2020-09-03 |
| 915 | _ | _ | |a Creative Commons Attribution CC BY 4.0 |0 LIC:(DE-HGF)CCBY4 |2 HGFVOC |
| 915 | _ | _ | |a JCR |0 StatID:(DE-HGF)0100 |2 StatID |b FRONT COMPUT NEUROSC : 2018 |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0501 |2 StatID |b DOAJ Seal |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0500 |2 StatID |b DOAJ |d 2020-09-03 |
| 915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0113 |2 StatID |b Science Citation Index Expanded |d 2020-09-03 |
| 915 | _ | _ | |a Fees |0 StatID:(DE-HGF)0700 |2 StatID |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |d 2020-09-03 |
| 915 | _ | _ | |a IF < 5 |0 StatID:(DE-HGF)9900 |2 StatID |d 2020-09-03 |
| 915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
| 915 | _ | _ | |a Peer Review |0 StatID:(DE-HGF)0030 |2 StatID |b DOAJ : Blind peer review |d 2020-09-03 |
| 915 | _ | _ | |a Article Processing Charges |0 StatID:(DE-HGF)0561 |2 StatID |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0300 |2 StatID |b Medline |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0320 |2 StatID |b PubMed Central |d 2020-09-03 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Clarivate Analytics Master Journal List |d 2020-09-03 |
| 920 | _ | _ | |l yes |
| 920 | 1 | _ | |0 I:(DE-Juel1)INM-6-20090406 |k INM-6 |l Computational and Systems Neuroscience |x 0 |
| 920 | 1 | _ | |0 I:(DE-Juel1)IAS-6-20130828 |k IAS-6 |l Theoretical Neuroscience |x 1 |
| 920 | 1 | _ | |0 I:(DE-Juel1)INM-10-20170113 |k INM-10 |l Jara-Institut Brain structure-function relationships |x 2 |
| 920 | 1 | _ | |0 I:(DE-82)080012_20140620 |k JARA-HPC |l JARA - HPC |x 3 |
| 980 | 1 | _ | |a APC |
| 980 | 1 | _ | |a FullTexts |
| 980 | _ | _ | |a journal |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a I:(DE-Juel1)INM-6-20090406 |
| 980 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
| 980 | _ | _ | |a I:(DE-Juel1)INM-10-20170113 |
| 980 | _ | _ | |a I:(DE-82)080012_20140620 |
| 980 | _ | _ | |a APC |
| 980 | _ | _ | |a UNRESTRICTED |
| 981 | _ | _ | |a I:(DE-Juel1)IAS-6-20130828 |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|