Memory in plain sight: A survey of the uncanny resemblances between diffusion models and associative memories
Diffusion Models (DMs) have recently set state-of-the-art on many generation benchmarks.
However, there are myriad ways to describe them mathematically, which makes it difficult to …
However, there are myriad ways to describe them mathematically, which makes it difficult to …
Dine: Dimensional interpretability of node embeddings
Graph representation learning methods, such as node embeddings, are powerful
approaches to map nodes into a latent vector space, allowing their use for various graph …
approaches to map nodes into a latent vector space, allowing their use for various graph …
Binary Associative Memory Networks: A Review of Mathematical Framework and Capacity Analysis
H Bao, Z Zhao - Information Sciences, 2024 - Elsevier
In recent years, heightened interest has been ignited in associative memory networks,
largely attributed to their perceived equivalence with the attention mechanism, a …
largely attributed to their perceived equivalence with the attention mechanism, a …
Sparse distributed memory is a continual learner
Continual learning is a problem for artificial neural networks that their biological counterparts
are adept at solving. Building on work using Sparse Distributed Memory (SDM) to connect a …
are adept at solving. Building on work using Sparse Distributed Memory (SDM) to connect a …
Learning to modulate random weights can induce task-specific contexts for economical meta and continual learning
Neural networks are vulnerable to catastrophic forgetting when data distributions are non-
stationary during continual online learning; learning of a later task often leads to forgetting of …
stationary during continual online learning; learning of a later task often leads to forgetting of …
SNNLP: energy-efficient natural language processing using spiking neural networks
As spiking neural networks receive more attention, we look toward applications of this
computing paradigm in fields other than computer vision and signal processing. One major …
computing paradigm in fields other than computer vision and signal processing. One major …
Using connectome features to constrain echo state networks
We report an improvement to the conventional Echo State Network (ESN) across three
benchmark chaotic time-series prediction tasks using fruit fly connectome data alone. We …
benchmark chaotic time-series prediction tasks using fruit fly connectome data alone. We …
Continual Learning in Bio-plausible Spiking Neural Networks with Hebbian and Spike Timing Dependent Plasticity: A Survey and Perspective
A Safa - arxiv preprint arxiv:2407.17305, 2024 - arxiv.org
Recently, the use bio-plausible learning techniques such as Hebbian and Spike-Timing-
Dependent Plasticity (STDP) have drawn significant attention for the design of compute …
Dependent Plasticity (STDP) have drawn significant attention for the design of compute …
Learning sparse binary code for maximum inner product search
Maximum inner product search (MIPS), combined with the hashing method, has become a
standard solution to similarity search problems. It often achieves an order of magnitude …
standard solution to similarity search problems. It often achieves an order of magnitude …
Brain-inspired wiring economics for artificial neural networks
XJ Zhang, JM Moore, TT Gao, X Zhang, G Yan - PNAS nexus, 2025 - academic.oup.com
Wiring patterns of brain networks embody a trade-off between information transmission,
geometric constraints, and metabolic cost, all of which must be balanced to meet functional …
geometric constraints, and metabolic cost, all of which must be balanced to meet functional …