Efficient spiking neural networks with sparse selective activation for continual learning

J Shen, W Ni, Q Xu, H Tang - Proceedings of the AAAI Conference on …, 2024 - ojs.aaai.org
The next generation of machine intelligence requires the capability of continual learning to
acquire new knowledge without forgetting the old one while conserving limited computing …

Discrete key-value bottleneck

F Träuble, A Goyal, N Rahaman… - International …, 2023 - proceedings.mlr.press
Deep neural networks perform well on classification tasks where data streams are iid and
labeled data is abundant. Challenges emerge with non-stationary training data streams …

Emergence of sparse representations from noise

T Bricken, R Schaeffer, B Olshausen, G Kreiman - 2023 - openreview.net
A hallmark of biological neural networks, which distinguishes them from their artificial
counterparts, is the high degree of sparsity in their activations. This discrepancy raises three …

Continual neural computation

M Tiezzi, S Marullo, F Becattini, S Melacci - Joint European Conference on …, 2024 - Springer
Continuously processing a stream of not-iid data by neural models with the goal of
progressively learning new skills is largely known to introduce significant challenges …

Elephant neural networks: Born to be a continual learner

Q Lan, AR Mahmood - arxiv preprint arxiv:2310.01365, 2023 - arxiv.org
Catastrophic forgetting remains a significant challenge to continual learning for decades.
While recent works have proposed effective methods to mitigate this problem, they mainly …

Reducing catastrophic forgetting with associative learning: a lesson from fruit flies

Y Shen, S Dasgupta, S Navlakha - Neural Computation, 2023 - direct.mit.edu
Catastrophic forgetting remains an outstanding challenge in continual learning. Recently,
methods inspired by the brain, such as continual representation learning and memory …

Generating Prompts in Latent Space for Rehearsal-free Continual Learning

C Yang, W Liu, S Chen, J Qi, A Zhou - Proceedings of the 32nd ACM …, 2024 - dl.acm.org
Continual learning emerges as a framework that trains the model on a sequence of tasks
without forgetting previously learned knowledge, which has been applied in multiple …

Key-value memory in the brain

SJ Gershman, I Fiete, K Irie - arxiv preprint arxiv:2501.02950, 2025 - arxiv.org
Classical models of memory in psychology and neuroscience rely on similarity-based
retrieval of stored patterns, where similarity is a function of retrieval cues and the stored …

Comply: Learning Sentences with Complex Weights inspired by Fruit Fly Olfaction

A Figueroa, J Westerhoff, A Golzar, D Fast… - arxiv preprint arxiv …, 2025 - arxiv.org
Biologically inspired neural networks offer alternative avenues to model data distributions.
FlyVec is a recent example that draws inspiration from the fruit fly's olfactory circuit to tackle …

Associative memory under the probabilistic lens: Improved transformers & dynamic memory creation

R Schaeffer, M Khona, N Zahedi, IR Fiete… - … Memory {\&} Hopfield …, 2023 - openreview.net
Clustering is a fundamental unsupervised learning problem, and recent work showed
modern continuous associative memory (AM) networks can learn to cluster data via a novel …