Engram neurons: Encoding, consolidation, retrieval, and forgetting of memory

A Guskjolen, MS Cembrowski - Molecular psychiatry, 2023 - nature.com
Tremendous strides have been made in our understanding of the neurobiological substrates
of memory–the so-called memory “engram”. Here, we integrate recent progress in the …

[HTML][HTML] Continual lifelong learning with neural networks: A review

GI Parisi, R Kemker, JL Part, C Kanan, S Wermter - Neural networks, 2019 - Elsevier
Humans and animals have the ability to continually acquire, fine-tune, and transfer
knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is …

Continual learning with deep generative replay

H Shin, JK Lee, J Kim, J Kim - Advances in neural …, 2017 - proceedings.neurips.cc
Attempts to train a comprehensive artificial intelligence capable of solving multiple tasks
have been impeded by a chronic problem called catastrophic forgetting. Although simply …

Remind your neural network to prevent catastrophic forgetting

TL Hayes, K Kafle, R Shrestha, M Acharya… - European conference on …, 2020 - Springer
People learn throughout life. However, incrementally updating conventional neural networks
leads to catastrophic forgetting. A common remedy is replay, which is inspired by how the …

Measuring catastrophic forgetting in neural networks

R Kemker, M McClure, A Abitino, T Hayes… - Proceedings of the AAAI …, 2018 - ojs.aaai.org
Deep neural networks are used in many state-of-the-art systems for machine perception.
Once a network is trained to do a specific task, eg, bird classification, it cannot easily be …

Replay in deep learning: Current approaches and missing biological elements

TL Hayes, GP Krishnan, M Bazhenov… - Neural …, 2021 - ieeexplore.ieee.org
Replay is the reactivation of one or more neural patterns that are similar to the activation
patterns experienced during past waking experiences. Replay was first observed in …

Random path selection for continual learning

J Rajasegaran, M Hayat, SH Khan… - Advances in neural …, 2019 - proceedings.neurips.cc
Incremental life-long learning is a main challenge towards the long-standing goal of Artificial
General Intelligence. In real-life settings, learning tasks arrive in a sequence and machine …

Ultrastructural evidence for synaptic scaling across the wake/sleep cycle

L De Vivo, M Bellesi, W Marshall, EA Bushong… - Science, 2017 - science.org
It is assumed that synaptic strengthening and weakening balance throughout learning to
avoid runaway potentiation and memory interference. However, energetic and informational …

[KNIHA][B] Lifelong machine learning

Z Chen, B Liu - 2018 - books.google.com
Lifelong Machine Learning, Second Edition is an introduction to an advanced machine
learning paradigm that continuously learns by accumulating past knowledge that it then …

Is plasticity of synapses the mechanism of long-term memory storage?

WC Abraham, OD Jones, DL Glanzman - NPJ science of learning, 2019 - nature.com
It has been 70 years since Donald Hebb published his formalized theory of synaptic
adaptation during learning. Hebb's seminal work foreshadowed some of the great …