Direct learning-based deep spiking neural networks: a review

Y Guo, X Huang, Z Ma - Frontiers in Neuroscience, 2023 - frontiersin.org
The spiking neural network (SNN), as a promising brain-inspired computational model with
binary spike information transmission mechanism, rich spatially-temporal dynamics, and …

Backpropagation-based learning techniques for deep spiking neural networks: A survey

M Dampfhoffer, T Mesquida… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
With the adoption of smart systems, artificial neural networks (ANNs) have become
ubiquitous. Conventional ANN implementations have high energy consumption, limiting …

Spike-driven transformer

M Yao, J Hu, Z Zhou, L Yuan, Y Tian… - Advances in neural …, 2023 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option
due to their unique spike-based event-driven (ie, spike-driven) paradigm. In this paper, we …

Spikformer: When spiking neural network meets transformer

Z Zhou, Y Zhu, C He, Y Wang, S Yan, Y Tian… - arxiv preprint arxiv …, 2022 - arxiv.org
We consider two biologically plausible structures, the Spiking Neural Network (SNN) and the
self-attention mechanism. The former offers an energy-efficient and event-driven paradigm …

Spike-based dynamic computing with asynchronous sensing-computing neuromorphic chip

M Yao, O Richter, G Zhao, N Qiao, Y **ng… - Nature …, 2024 - nature.com
By mimicking the neurons and synapses of the human brain and employing spiking neural
networks on neuromorphic chips, neuromorphic computing offers a promising energy …

Attention spiking neural networks

M Yao, G Zhao, H Zhang, Y Hu, L Deng… - IEEE transactions on …, 2023 - ieeexplore.ieee.org
Brain-inspired spiking neural networks (SNNs) are becoming a promising energy-efficient
alternative to traditional artificial neural networks (ANNs). However, the performance gap …

Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics

H Zheng, Z Zheng, R Hu, B **ao, Y Wu, F Yu… - Nature …, 2024 - nature.com
It is widely believed the brain-inspired spiking neural networks have the capability of
processing temporal information owing to their dynamic attributes. However, how to …

Training high-performance low-latency spiking neural networks by differentiation on spike representation

Q Meng, M **ao, S Yan, Y Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Spiking Neural Network (SNN) is a promising energy-efficient AI model when
implemented on neuromorphic hardware. However, it is a challenge to efficiently train SNNs …

Deep residual learning in spiking neural networks

W Fang, Z Yu, Y Chen, T Huang… - Advances in Neural …, 2021 - proceedings.neurips.cc
Abstract Deep Spiking Neural Networks (SNNs) present optimization difficulties for gradient-
based approaches due to discrete binary activation and complex spatial-temporal dynamics …

Temporal effective batch normalization in spiking neural networks

C Duan, J Ding, S Chen, Z Yu… - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) are promising in neuromorphic hardware owing to
utilizing spatio-temporal information and sparse event-driven signal processing. However, it …