Direct learning-based deep spiking neural networks: a review

Y Guo, X Huang, Z Ma - Frontiers in Neuroscience, 2023 - frontiersin.org
The spiking neural network (SNN), as a promising brain-inspired computational model with
binary spike information transmission mechanism, rich spatially-temporal dynamics, and …

Backpropagation-based learning techniques for deep spiking neural networks: A survey

M Dampfhoffer, T Mesquida… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
With the adoption of smart systems, artificial neural networks (ANNs) have become
ubiquitous. Conventional ANN implementations have high energy consumption, limiting …

Spikformer: When spiking neural network meets transformer

Z Zhou, Y Zhu, C He, Y Wang, S Yan, Y Tian… - arxiv preprint arxiv …, 2022 - arxiv.org
We consider two biologically plausible structures, the Spiking Neural Network (SNN) and the
self-attention mechanism. The former offers an energy-efficient and event-driven paradigm …

Temporal effective batch normalization in spiking neural networks

C Duan, J Ding, S Chen, Z Yu… - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) are promising in neuromorphic hardware owing to
utilizing spatio-temporal information and sparse event-driven signal processing. However, it …

Constructing deep spiking neural networks from artificial neural networks with knowledge distillation

Q Xu, Y Li, J Shen, JK Liu, H Tang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Spiking neural networks (SNNs) are well known as the brain-inspired models with high
computing efficiency, due to a key component that they utilize spikes as information units …

SpikingResformer: bridging ResNet and vision transformer in spiking neural networks

X Shi, Z Hao, Z Yu - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
The remarkable success of Vision Transformers in Artificial Neural Networks (ANNs) has led
to a growing interest in incorporating the self-attention mechanism and transformer-based …

Towards memory-and time-efficient backpropagation for training spiking neural networks

Q Meng, M **ao, S Yan, Y Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Spiking Neural Networks (SNNs) are promising energy-efficient models for
neuromorphic computing. For training the non-differentiable SNN models, the …

Effective surrogate gradient learning with high-order information bottleneck for spike-based machine intelligence

S Yang, B Chen - IEEE transactions on neural networks and …, 2023 - ieeexplore.ieee.org
Brain-inspired computing technique presents a promising approach to prompt the rapid
development of artificial general intelligence (AGI). As one of the most critical aspects …

Learning rules in spiking neural networks: A survey

Z Yi, J Lian, Q Liu, H Zhu, D Liang, J Liu - Neurocomputing, 2023 - Elsevier
Spiking neural networks (SNNs) are a promising energy-efficient alternative to artificial
neural networks (ANNs) due to their rich dynamics, capability to process spatiotemporal …

Parallel spiking neurons with high efficiency and ability to learn long-term dependencies

W Fang, Z Yu, Z Zhou, D Chen… - Advances in …, 2023 - proceedings.neurips.cc
Vanilla spiking neurons in Spiking Neural Networks (SNNs) use charge-fire-reset neuronal
dynamics, which can only be simulated serially and can hardly learn long-time …