A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost
Neuromodulators in the brain act globally at many forms of synaptic plasticity, represented
as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking …
as metaplasticity, which is rarely considered by existing spiking (SNNs) and nonspiking …
Holomorphic equilibrium propagation computes exact gradients through finite size oscillations
Equilibrium propagation (EP) is an alternative to backpropagation (BP) that allows the
training of deep neural networks with local learning rules. It thus provides a compelling …
training of deep neural networks with local learning rules. It thus provides a compelling …
On training implicit models
This paper focuses on training implicit models of infinite layers. Specifically, previous works
employ implicit differentiation and solve the exact gradient for the backward propagation …
employ implicit differentiation and solve the exact gradient for the backward propagation …
Gradients without backpropagation
Using backpropagation to compute gradients of objective functions for optimization has
remained a mainstay of machine learning. Backpropagation, or reverse-mode differentiation …
remained a mainstay of machine learning. Backpropagation, or reverse-mode differentiation …
Self-backpropagation of synaptic modifications elevates the efficiency of spiking and artificial neural networks
Many synaptic plasticity rules found in natural circuits have not been incorporated into
artificial neural networks (ANNs). We showed that incorporating a nonlocal feature of …
artificial neural networks (ANNs). We showed that incorporating a nonlocal feature of …
Bottom-up and top-down approaches for the design of neuromorphic processing systems: tradeoffs and synergies between natural and artificial intelligence
While Moore's law has driven exponential computing power expectations, its nearing end
calls for new avenues for improving the overall system performance. One of these avenues …
calls for new avenues for improving the overall system performance. One of these avenues …
Information Geometry? Exercises de Styles
Indeed, information geometry, IG is an ever-growing area with a great scope of applications
ranging from Probability & Statistics, Machine Learning (ML), Artificial Intelligence (AI) …
ranging from Probability & Statistics, Machine Learning (ML), Artificial Intelligence (AI) …
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation
For both humans and machines, the essence of learning is to pinpoint which components in
its information processing pipeline are responsible for an error in its output, a challenge that …
its information processing pipeline are responsible for an error in its output, a challenge that …
The least-control principle for local learning at equilibrium
Equilibrium systems are a powerful way to express neural computations. As special cases,
they include models of great current interest in both neuroscience and machine learning …
they include models of great current interest in both neuroscience and machine learning …
Bottom-up and top-down neural processing systems design: Neuromorphic intelligence as the convergence of natural and artificial intelligence
While Moore's law has driven exponential computing power expectations, its nearing end
calls for new avenues for improving the overall system performance. One of these avenues …
calls for new avenues for improving the overall system performance. One of these avenues …