Representational drift: Emerging theories for continual learning and experimental future directions

LN Driscoll, L Duncker, CD Harvey - Current Opinion in Neurobiology, 2022 - Elsevier
Recent work has revealed that the neural activity patterns correlated with sensation,
cognition, and action often are not stable and instead undergo large scale changes over …

Continual learning for recurrent neural networks: an empirical evaluation

A Cossu, A Carta, V Lomonaco, D Bacciu - Neural Networks, 2021 - Elsevier
Learning continuously during all model lifetime is fundamental to deploy machine learning
solutions robust to drifts in the data distribution. Advances in Continual Learning (CL) with …

Three types of incremental learning

GM Van de Ven, T Tuytelaars, AS Tolias - Nature Machine Intelligence, 2022 - nature.com
Incrementally learning new information from a non-stationary stream of data, referred to as
'continual learning', is a key feature of natural intelligence, but a challenging problem for …

Online continual learning in image classification: An empirical survey

Z Mai, R Li, J Jeong, D Quispe, H Kim, S Sanner - Neurocomputing, 2022 - Elsevier
Online continual learning for image classification studies the problem of learning to classify
images from an online stream of data and tasks, where tasks may include new classes …

[HTML][HTML] Flexible multitask computation in recurrent networks utilizes shared dynamical motifs

LN Driscoll, K Shenoy, D Sussillo - Nature Neuroscience, 2024 - nature.com
Flexible computation is a hallmark of intelligent behavior. However, little is known about how
neural networks contextually reconfigure for different computations. In the present work, we …

The role of population structure in computations through neural dynamics

A Dubreuil, A Valente, M Beiran… - Nature …, 2022 - nature.com
Neural computations are currently investigated using two separate approaches: sorting
neurons into functional subpopulations or examining the low-dimensional dynamics of …

Learning leaves a memory trace in motor cortex

DM Losey, JA Hennig, ER Oby, MD Golub, PT Sadtler… - Current Biology, 2024 - cell.com
How are we able to learn new behaviors without disrupting previously learned ones? To
understand how the brain achieves this, we used a brain-computer interface (BCI) learning …

Natural continual learning: success is a journey, not (just) a destination

TC Kao, K Jensen, G van de Ven… - Advances in neural …, 2021 - proceedings.neurips.cc
Biological agents are known to learn many different tasks over the course of their lives, and
to be able to revisit previous tasks and behaviors with little to no loss in performance. In …

Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals

T Flesch, DG Nagy, A Saxe… - PLoS computational …, 2023 - journals.plos.org
Humans can learn several tasks in succession with minimal mutual interference but perform
more poorly when trained on multiple tasks at once. The opposite is true for standard deep …

[HTML][HTML] Measuring and modeling the motor system with machine learning

SB Hausmann, AM Vargas, A Mathis… - Current opinion in …, 2021 - Elsevier
The utility of machine learning in understanding the motor system is promising a revolution
in how to collect, measure, and analyze data. The field of movement science already …