A comprehensive survey of continual learning: theory, method and application
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …
Continual object detection: a review of definitions, strategies, and challenges
Abstract The field of Continual Learning investigates the ability to learn consecutive tasks
without losing performance on those previously learned. The efforts of researchers have …
without losing performance on those previously learned. The efforts of researchers have …
Co2l: Contrastive continual learning
Recent breakthroughs in self-supervised learning show that such algorithms learn visual
representations that can be transferred better to unseen tasks than cross-entropy based …
representations that can be transferred better to unseen tasks than cross-entropy based …
Online prototype learning for online continual learning
Online continual learning (CL) studies the problem of learning continuously from a single-
pass data stream while adapting to new data and mitigating catastrophic forgetting …
pass data stream while adapting to new data and mitigating catastrophic forgetting …
On the importance and applicability of pre-training for federated learning
Pre-training is prevalent in nowadays deep learning to improve the learned model's
performance. However, in the literature on federated learning (FL), neural networks are …
performance. However, in the literature on federated learning (FL), neural networks are …
Self-supervision can be a good few-shot learner
Existing few-shot learning (FSL) methods rely on training with a large labeled dataset, which
prevents them from leveraging abundant unlabeled data. From an information-theoretic …
prevents them from leveraging abundant unlabeled data. From an information-theoretic …
Clad: A realistic continual learning benchmark for autonomous driving
In this paper we describe the design and the ideas motivating a new Continual Learning
benchmark for Autonomous Driving (CLAD), that focuses on the problems of object …
benchmark for Autonomous Driving (CLAD), that focuses on the problems of object …
Online continual learning for embedded devices
Real-time on-device continual learning is needed for new applications such as home robots,
user personalization on smartphones, and augmented/virtual reality headsets. However, this …
user personalization on smartphones, and augmented/virtual reality headsets. However, this …
Plasticity-optimized complementary networks for unsupervised continual learning
Continuous unsupervised representation learning (CURL) research has greatly benefited
from improvements in self-supervised learning (SSL) techniques. As a result, existing CURL …
from improvements in self-supervised learning (SSL) techniques. As a result, existing CURL …
A unified approach to domain incremental learning with memory: Theory and algorithm
Abstract Domain incremental learning aims to adapt to a sequence of domains with access
to only a small subset of data (ie, memory) from previous domains. Various methods have …
to only a small subset of data (ie, memory) from previous domains. Various methods have …