
handle: 11585/958504 , 20.500.11850/652060
Neuromorphic computing has been identified as an ideal candidate to exploit the potential of event-based cameras, a promising sensor for embedded computer vision. However, state-of-the-art neuromorphic models try to maximize the model performance on large platforms rather than a trade-off between memory requirements and performance. We present the first deployment of an embedded neuromorphic algorithm on Kraken, a low-power RISC-V-based SoC prototype including a neuromorphic spiking neural network (SNN) accelerator. In addition, the model employed in this paper was designed to achieve visual attention detection on event data while minimizing the neuronal populations’ size and the inference latency. Experimental results show that it is possible to achieve saliency detection in event data with a delay of 32ms, maintains classification accuracy of 84.51% and consumes only 3.85mJ per second of processed input data, achieving all of this while processing input data 10 times faster than real-time. This trade-off between decision latency, power consumption, accuracy, and run time significantly outperforms those achieved by previous implementations on CPU and neuromorphic hardware.
Academic platform, [INFO.INFO-CV] Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV], [SPI.NANO] Engineering Sciences [physics]/Micro and nanotechnologies/Microelectronics, Neuromorphic; Embedded system; Event camera; Academic platform, Neuromorphic, Visualization , Neuromorphics , Computational modeling , Inference algorithms , Hardware , Data models , Real-time systems, [INFO] Computer Science [cs], Embedded system, Event camera, Visual attention, OPAL-Meso
Academic platform, [INFO.INFO-CV] Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV], [SPI.NANO] Engineering Sciences [physics]/Micro and nanotechnologies/Microelectronics, Neuromorphic; Embedded system; Event camera; Academic platform, Neuromorphic, Visualization , Neuromorphics , Computational modeling , Inference algorithms , Hardware , Data models , Real-time systems, [INFO] Computer Science [cs], Embedded system, Event camera, Visual attention, OPAL-Meso
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
