001 | 1028217 | ||
005 | 20250204113906.0 | ||
024 | 7 | _ | |a 10.1038/s42256-024-00846-2 |2 doi |
024 | 7 | _ | |a 10.34734/FZJ-2024-04411 |2 datacite_doi |
024 | 7 | _ | |a WOS:001258009300004 |2 WOS |
037 | _ | _ | |a FZJ-2024-04411 |
082 | _ | _ | |a 004 |
100 | 1 | _ | |a Renner, Alpha |0 P:(DE-Juel1)201426 |b 0 |e Corresponding author |
245 | _ | _ | |a Visual odometry with neuromorphic resonator networks |
260 | _ | _ | |a London |c 2024 |b Springer Nature Publishing |
336 | 7 | _ | |a article |2 DRIVER |
336 | 7 | _ | |a Output Types/Journal article |2 DataCite |
336 | 7 | _ | |a Journal Article |b journal |m journal |0 PUB:(DE-HGF)16 |s 1734427835_28897 |2 PUB:(DE-HGF) |
336 | 7 | _ | |a ARTICLE |2 BibTeX |
336 | 7 | _ | |a JOURNAL_ARTICLE |2 ORCID |
336 | 7 | _ | |a Journal Article |0 0 |2 EndNote |
520 | _ | _ | |a Visual odometry (VO) is a method used to estimate self-motion of a mobile robot using visual sensors. Unlike odometry based on integrating differential measurements that can accumulate errors, such as inertial sensors or wheel encoders, VO is not compromised by drift. However, image-based VO is computationally demanding, limiting its application in use cases with low-latency, low-memory and low-energy requirements. Neuromorphic hardware offers low-power solutions to many vision and artificial intelligence problems, but designing such solutions is complicated and often has to be assembled from scratch. Here we propose the use of vector symbolic architecture (VSA) as an abstraction layer to design algorithms compatible with neuromorphic hardware. Building from a VSA model for scene analysis, described in our companion paper, we present a modular neuromorphic algorithm that achieves state-of-the-art performance on two-dimensional VO tasks. Specifically, the proposed algorithm stores and updates a working memory of the presented visual environment. Based on this working memory, a resonator network estimates the changing location and orientation of the camera. We experimentally validate the neuromorphic VSA-based approach to VO with two benchmarks: one based on an event-camera dataset and the other in a dynamic scene with a robotic task. |
536 | _ | _ | |a 5234 - Emerging NC Architectures (POF4-523) |0 G:(DE-HGF)POF4-5234 |c POF4-523 |f POF IV |x 0 |
588 | _ | _ | |a Dataset connected to DataCite |
700 | 1 | _ | |a Supic, Lazar |0 0000-0002-3954-9688 |b 1 |e Corresponding author |
700 | 1 | _ | |a Danielescu, Andreea |0 0000-0001-7460-2467 |b 2 |
700 | 1 | _ | |a Indiveri, Giacomo |0 0000-0002-7109-1689 |b 3 |
700 | 1 | _ | |a Frady, E. Paxon |0 0000-0001-8248-4544 |b 4 |
700 | 1 | _ | |a Sommer, Friedrich T. |0 0000-0002-6738-9263 |b 5 |e Corresponding author |
700 | 1 | _ | |a Sandamirskaya, Yulia |0 0000-0003-4684-202X |b 6 |e Corresponding author |
773 | _ | _ | |a 10.1038/s42256-024-00846-2 |0 PERI:(DE-600)2933875-X |n 6 |p 653–663 |t Nature machine intelligence |v 6 |y 2024 |x 2522-5839 |
856 | 4 | _ | |u https://juser.fz-juelich.de/record/1028217/files/2209.02000v3.pdf |y OpenAccess |
909 | C | O | |o oai:juser.fz-juelich.de:1028217 |p openaire |p open_access |p VDB |p driver |p dnbdelivery |
910 | 1 | _ | |a Forschungszentrum Jülich |0 I:(DE-588b)5008462-8 |k FZJ |b 0 |6 P:(DE-Juel1)201426 |
913 | 1 | _ | |a DE-HGF |b Key Technologies |l Natural, Artificial and Cognitive Information Processing |1 G:(DE-HGF)POF4-520 |0 G:(DE-HGF)POF4-523 |3 G:(DE-HGF)POF4 |2 G:(DE-HGF)POF4-500 |4 G:(DE-HGF)POF |v Neuromorphic Computing and Network Dynamics |9 G:(DE-HGF)POF4-5234 |x 0 |
914 | 1 | _ | |y 2024 |
915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0160 |2 StatID |b Essential Science Indicators |d 2023-08-29 |
915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0113 |2 StatID |b Science Citation Index Expanded |d 2023-08-29 |
915 | _ | _ | |a DEAL Nature |0 StatID:(DE-HGF)3003 |2 StatID |d 2023-08-29 |w ger |
915 | _ | _ | |a OpenAccess |0 StatID:(DE-HGF)0510 |2 StatID |
915 | _ | _ | |a JCR |0 StatID:(DE-HGF)0100 |2 StatID |b NAT MACH INTELL : 2022 |d 2024-12-05 |
915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |d 2024-12-05 |
915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0300 |2 StatID |b Medline |d 2024-12-05 |
915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Clarivate Analytics Master Journal List |d 2024-12-05 |
915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1160 |2 StatID |b Current Contents - Engineering, Computing and Technology |d 2024-12-05 |
915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |d 2024-12-05 |
915 | _ | _ | |a IF >= 20 |0 StatID:(DE-HGF)9920 |2 StatID |b NAT MACH INTELL : 2022 |d 2024-12-05 |
920 | 1 | _ | |0 I:(DE-Juel1)PGI-15-20210701 |k PGI-15 |l Neuromorphic Software Eco System |x 0 |
980 | _ | _ | |a journal |
980 | _ | _ | |a VDB |
980 | _ | _ | |a UNRESTRICTED |
980 | _ | _ | |a I:(DE-Juel1)PGI-15-20210701 |
980 | 1 | _ | |a FullTexts |
Library | Collection | CLSMajor | CLSMinor | Language | Author |
---|