Direct learning-based deep spiking neural networks: a review

Y Guo, X Huang, Z Ma - Frontiers in Neuroscience, 2023 - frontiersin.org
The spiking neural network (SNN), as a promising brain-inspired computational model with
binary spike information transmission mechanism, rich spatially-temporal dynamics, and …

Direct training high-performance deep spiking neural networks: a review of theories and methods

C Zhou, H Zhang, L Yu, Y Ye, Z Zhou… - Frontiers in …, 2024 - frontiersin.org
Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial
neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal …

Spike-driven transformer

M Yao, J Hu, Z Zhou, L Yuan, Y Tian… - Advances in neural …, 2024 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option
due to their unique spike-based event-driven (ie, spike-driven) paradigm. In this paper, we …

Spikformer: When spiking neural network meets transformer

Z Zhou, Y Zhu, C He, Y Wang, S Yan, Y Tian… - arxiv preprint arxiv …, 2022 - arxiv.org
We consider two biologically plausible structures, the Spiking Neural Network (SNN) and the
self-attention mechanism. The former offers an energy-efficient and event-driven paradigm …

Online training through time for spiking neural networks

M **ao, Q Meng, Z Zhang, D He… - Advances in neural …, 2022 - proceedings.neurips.cc
Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models.
Recent progress in training methods has enabled successful deep SNNs on large-scale …

Rmp-loss: Regularizing membrane potential distribution for spiking neural networks

Y Guo, X Liu, Y Chen, L Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Spiking Neural Networks (SNNs) as one of the biology-inspired models have
received much attention recently. It can significantly reduce energy consumption since they …

Effective surrogate gradient learning with high-order information bottleneck for spike-based machine intelligence

S Yang, B Chen - IEEE transactions on neural networks and …, 2023 - ieeexplore.ieee.org
Brain-inspired computing technique presents a promising approach to prompt the rapid
development of artificial general intelligence (AGI). As one of the most critical aspects …

Exploring loss functions for time-based training strategy in spiking neural networks

Y Zhu, W Fang, X **e, T Huang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) are considered promising brain-inspired energy-
efficient models due to their event-driven computing paradigm. The spatiotemporal spike …

Brain-inspired computing: A systematic survey and future trends

G Li, L Deng, H Tang, G Pan, Y Tian… - Proceedings of the …, 2024 - ieeexplore.ieee.org
Brain-inspired computing (BIC) is an emerging research field that aims to build fundamental
theories, models, hardware architectures, and application systems toward more general …

Towards memory-and time-efficient backpropagation for training spiking neural networks

Q Meng, M **ao, S Yan, Y Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Spiking Neural Networks (SNNs) are promising energy-efficient models for
neuromorphic computing. For training the non-differentiable SNN models, the …