Spike-driven transformer

M Yao, J Hu, Z Zhou, L Yuan, Y Tian… - Advances in neural …, 2023 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option
due to their unique spike-based event-driven (ie, spike-driven) paradigm. In this paper, we …

Spike-based dynamic computing with asynchronous sensing-computing neuromorphic chip

M Yao, O Richter, G Zhao, N Qiao, Y **ng… - Nature …, 2024 - nature.com
By mimicking the neurons and synapses of the human brain and employing spiking neural
networks on neuromorphic chips, neuromorphic computing offers a promising energy …

Brain-inspired computing: A systematic survey and future trends

G Li, L Deng, H Tang, G Pan, Y Tian… - Proceedings of the …, 2024 - ieeexplore.ieee.org
Brain-inspired computing (BIC) is an emerging research field that aims to build fundamental
theories, models, hardware architectures, and application systems toward more general …

Integer-valued training and spike-driven inference spiking neural network for high-performance and energy-efficient object detection

X Luo, M Yao, Y Chou, B Xu, G Li - European Conference on Computer …, 2024 - Springer
Abstract Brain-inspired Spiking Neural Networks (SNNs) have bio-plausibility and low-
power advantages over Artificial Neural Networks (ANNs). Applications of SNNs are …

Spiking tucker fusion transformer for audio-visual zero-shot learning

W Li, P Wang, R **ong, X Fan - IEEE Transactions on Image …, 2024 - ieeexplore.ieee.org
The spiking neural networks (SNNs) that efficiently encode temporal sequences have shown
great potential in extracting audio-visual joint feature representations. However, coupling …

High-Performance Temporal Reversible Spiking Neural Networks with Training Memory and Inference Cost

JK Hu, M Yao, X Qiu, Y Chou, Y Cai, N Qiao… - arxiv preprint arxiv …, 2024 - arxiv.org
Multi-timestep simulation of brain-inspired Spiking Neural Networks (SNNs) boost memory
requirements during training and increase inference energy cost. Current training methods …

Scaling spike-driven transformer with efficient spike firing approximation training

M Yao, X Qiu, T Hu, J Hu, Y Chou… - … on Pattern Analysis …, 2025 - ieeexplore.ieee.org
The ambition of brain-inspired Spiking Neural Networks (SNNs) is to become a low-power
alternative to traditional Artificial Neural Networks (ANNs). This work addresses two major …

Auto-spikformer: Spikformer architecture search

K Che, Z Zhou, J Niu, Z Ma, W Fang, Y Chen… - Frontiers in …, 2024 - frontiersin.org
Introduction The integration of self-attention mechanisms into Spiking Neural Networks
(SNNs) has garnered considerable interest in the realm of advanced deep learning …

Eventaugment: learning augmentation policies from asynchronous event-based data

F Gu, J Dou, M Li, X Long, S Guo… - … on Cognitive and …, 2024 - ieeexplore.ieee.org
Data augmentation is an effective way to overcome the overfitting problem of deep learning
models. However, most existing studies on data augmentation work on framelike data (eg …

High-Performance Temporal Reversible Spiking Neural Networks with Training Memory and Inference Cost

JK Hu, M Yao, X Qiu, Y Chou, Y Cai, N Qiao… - … on Machine Learning, 2024 - openreview.net
Multi-timestep simulation of brain-inspired Spiking Neural Networks (SNNs) boost memory
requirements during training and increase inference energy cost. Current training methods …