A comprehensive survey of continual learning: theory, method and application
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
A comprehensive survey of forgetting in deep learning beyond continual learning
Forgetting refers to the loss or deterioration of previously acquired knowledge. While
existing surveys on forgetting have primarily focused on continual learning, forgetting is a …
existing surveys on forgetting have primarily focused on continual learning, forgetting is a …
Computationally budgeted continual learning: What does matter?
Continual Learning (CL) aims to sequentially train models on streams of incoming data that
vary in distribution by preserving previous knowledge while adapting to new data. Current …
vary in distribution by preserving previous knowledge while adapting to new data. Current …
Real-time evaluation in online continual learning: A new hope
Abstract Current evaluations of Continual Learning (CL) methods typically assume that there
is no constraint on training time and computation. This is an unrealistic assumption for any …
is no constraint on training time and computation. This is an unrealistic assumption for any …
Task-free continual learning via online discrepancy distance learning
Learning from non-stationary data streams, also called Task-Free Continual Learning
(TFCL) remains challenging due to the absence of explicit task information in most …
(TFCL) remains challenging due to the absence of explicit task information in most …
The ideal continual learner: An agent that never forgets
The goal of continual learning is to find a model that solves multiple learning tasks which are
presented sequentially to the learner. A key challenge in this setting is that the learner may" …
presented sequentially to the learner. A key challenge in this setting is that the learner may" …
Online continual learning without the storage constraint
Traditional online continual learning (OCL) research has primarily focused on mitigating
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …
On the opportunities of green computing: A survey
Artificial Intelligence (AI) has achieved significant advancements in technology and research
with the development over several decades, and is widely used in many areas including …
with the development over several decades, and is widely used in many areas including …
Lifelong robotic reinforcement learning by retaining experiences
Multi-task learning ideally allows embodied agents such as robots to acquire a diverse
repertoire of useful skills. However, many multi-task reinforcement learning efforts assume …
repertoire of useful skills. However, many multi-task reinforcement learning efforts assume …
Knowledge restore and transfer for multi-label class-incremental learning
Current class-incremental learning research mainly focuses on single-label classification
tasks while multi-label class-incremental learning (MLCIL) with more practical application …
tasks while multi-label class-incremental learning (MLCIL) with more practical application …