In this article, we aim to provide a literature review of different formulations and approaches
to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We …

We update complementary learning systems (CLS) theory, which holds that intelligent
agents must possess two learning systems, instantiated in mammalians in neocortex and …

Replay is the reactivation of one or more neural patterns that are similar to the activation
patterns experienced during past waking experiences. Replay was first observed in …

All natural cognitive systems, and, in particular, our own, gradually forget previously learned
information. Plausible models of human cognition should therefore exhibit similar patterns of …

This second edition of the must-read work in the field presents generic computational
models and techniques that can be used for the development of evolving, adaptive modeling …

Many methods and models have been proposed for solving difficult problems such as
prediction, planning and knowledge discovery in application areas such as bioinformatics …

Memory loss in retrograde amnesia has long been held to be larger for recent periods than
for remote periods, a pattern usually referred to as the Ribot gradient. One explanation for …

Catastrophic forgetting (CF) refers to the sudden and severe loss of prior information in
learning systems when acquiring new information. CF has been an Achilles heel of standard …

The ability to continuously learn and adapt itself to new tasks, without losing grasp of already
acquired knowledge is a hallmark of biological learning systems, which current deep …

In order to solve the'sensitivity-stability'problem-and its immediate correlate, the problem of
sequential learning-it is crucial to develop connectionist architectures that are …