TY  - EJOUR
AU  - Yik, Jason
AU  - Berghe, Korneel Van den
AU  - Blanken, Douwe den
AU  - Bouhadjar, Younes
AU  - Fabre, Maxime
AU  - Hueber, Paul
AU  - Kleyko, Denis
AU  - Pacik-Nelson, Noah
AU  - Sun, Pao-Sheng Vincent
AU  - Tang, Guangzhi
AU  - Wang, Shenqi
AU  - Zhou, Biyan
AU  - Ahmed, Soikat Hasan
AU  - Joseph, George Vathakkattil
AU  - Leto, Benedetto
AU  - Micheli, Aurora
AU  - Mishra, Anurag Kumar
AU  - Lenz, Gregor
AU  - Sun, Tao
AU  - Ahmed, Zergham
AU  - Akl, Mahmoud
AU  - Anderson, Brian
AU  - Andreou, Andreas G.
AU  - Bartolozzi, Chiara
AU  - Basu, Arindam
AU  - Bogdan, Petrut
AU  - Bohte, Sander
AU  - Buckley, Sonia
AU  - Cauwenberghs, Gert
AU  - Chicca, Elisabetta
AU  - Corradi, Federico
AU  - de Croon, Guido
AU  - Danielescu, Andreea
AU  - Daram, Anurag
AU  - Davies, Mike
AU  - Demirag, Yigit
AU  - Eshraghian, Jason
AU  - Fischer, Tobias
AU  - Forest, Jeremy
AU  - Fra, Vittorio
AU  - Furber, Steve
AU  - Furlong, P. Michael
AU  - Gilpin, William
AU  - Gilra, Aditya
AU  - Gonzalez, Hector A.
AU  - Indiveri, Giacomo
AU  - Joshi, Siddharth
AU  - Karia, Vedant
AU  - Khacef, Lyes
AU  - Knight, James C.
AU  - Kriener, Laura
AU  - Kubendran, Rajkumar
AU  - Kudithipudi, Dhireesha
AU  - Liu, Yao-Hong
AU  - Liu, Shih-Chii
AU  - Ma, Haoyuan
AU  - Manohar, Rajit
AU  - Margarit-Taulé, Josep Maria
AU  - Mayr, Christian
AU  - Michmizos, Konstantinos
AU  - Muir, Dylan
AU  - Neftci, Emre
AU  - Nowotny, Thomas
AU  - Ottati, Fabrizio
AU  - Ozcelikkale, Ayca
AU  - Panda, Priyadarshini
AU  - Park, Jongkil
AU  - Payvand, Melika
AU  - Pehle, Christian
AU  - Petrovici, Mihai A.
AU  - Pierro, Alessandro
AU  - Posch, Christoph
AU  - Renner, Alpha
AU  - Sandamirskaya, Yulia
AU  - Schaefer, Clemens JS
AU  - van Schaik, André
AU  - Schemmel, Johannes
AU  - Schmidgall, Samuel
AU  - Schuman, Catherine
AU  - Seo, Jae-sun
AU  - Sheik, Sadique
AU  - Shrestha, Sumit Bam
AU  - Sifalakis, Manolis
AU  - Sironi, Amos
AU  - Stewart, Matthew
AU  - Stewart, Kenneth
AU  - Stewart, Terrence C.
AU  - Stratmann, Philipp
AU  - Timcheck, Jonathan
AU  - Tömen, Nergis
AU  - Urgese, Gianvito
AU  - Verhelst, Marian
AU  - Vineyard, Craig M.
AU  - Vogginger, Bernhard
AU  - Yousefzadeh, Amirreza
AU  - Zohora, Fatima Tuz
AU  - Frenkel, Charlotte
AU  - Reddi, Vijay Janapa
TI  - NeuroBench: A Framework for Benchmarking Neuromorphic Computing Algorithms and Systems
PB  - arXiv
M1  - FZJ-2024-02520
PY  - 2023
AB  - Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. Prior neuromorphic computing benchmark efforts have not seen widespread adoption due to a lack of inclusive, actionable, and iterative benchmark design and guidelines. To address these shortcomings, we present NeuroBench: a benchmark framework for neuromorphic computing algorithms and systems. NeuroBench is a collaboratively-designed effort from an open community of nearly 100 co-authors across over 50 institutions in industry and academia, aiming to provide a representative structure for standardizing the evaluation of neuromorphic approaches. The NeuroBench framework introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent (algorithm track) and hardware-dependent (system track) settings. In this article, we present initial performance baselines across various model architectures on the algorithm track and outline the system track benchmark tasks and guidelines. NeuroBench is intended to continually expand its benchmarks and features to foster and track the progress made by the research community.
KW  - Artificial Intelligence (cs.AI) (Other)
KW  - FOS: Computer and information sciences (Other)
LB  - PUB:(DE-HGF)25
DO  - DOI:10.48550/ARXIV.2304.04640
UR  - https://juser.fz-juelich.de/record/1024854
ER  -