Poster (After Call)

FZJ-2024-06528

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Online Transformers with Spiking Neurons for Fast Prosthetic Hand Control

Neftci, E.FZJ* ; Finkbeiner, J. R.FZJ* ; Leroux, N.FZJ*

2023

Abstract: Fast and accurate online processing is essential for smooth prosthetic hand control with Surface Electromyography signals (sEMG). Although transformers are state-of-the-art deep learning models in signal processing, the self-attention mechanism at the core of their operations requires accumulating data for large time-windows. They are therefore not suited for online signal processing. In this paper, we use an attention mechanism with sliding windows that allows a transformer to process sequences element-by-element. Moreover, we increase the sparsity of the network using spiking neurons. We test the model on the NinaproDB8 finger position regression dataset. Our model sets its new state-of-the-art in terms of accuracy on NinaproDB8, while requiring only very short time windows of 3.5 ms at each inference step, and reducing the number of synaptic operations up to a factor of ×5.3 thanks to the spiking neurons. Our results hold great promises for wearable online sEMG processing systems for prosthetic hand control.

Note: Also published in 2023 IEEE Biomedical Circuits and Systems Conference (BioCAS), Electronic ISBN:979-8-3503-0026-0Print on Demand(PoD) ISBN:979-8-3503-0027-7

---

Contributing Institute(s):

1. Neuromorphic Software Eco System (PGI-15)

Research Program(s):

1. 5234 - Emerging NC Architectures (POF4-523) (POF4-523)

Appears in the scientific report 2024

---