A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Continual learning of large language models: A comprehensive survey

H Shi, Z Xu, H Wang, W Qin, W Wang, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The recent success of large language models (LLMs) trained on static, pre-collected,
general datasets has sparked numerous research directions and applications. One such …

Computationally budgeted continual learning: What does matter?

A Prabhu, HA Al Kader Hammoud… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual Learning (CL) aims to sequentially train models on streams of incoming data that
vary in distribution by preserving previous knowledge while adapting to new data. Current …

Wild-time: A benchmark of in-the-wild distribution shift over time

H Yao, C Choi, B Cao, Y Lee… - Advances in Neural …, 2022 - proceedings.neurips.cc
Distribution shifts occur when the test distribution differs from the training distribution, and
can considerably degrade performance of machine learning models deployed in the real …

Real-time evaluation in online continual learning: A new hope

Y Ghunaim, A Bibi, K Alhamoud… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Current evaluations of Continual Learning (CL) methods typically assume that there
is no constraint on training time and computation. This is an unrealistic assumption for any …

The clear benchmark: Continual learning on real-world imagery

Z Lin, J Shi, D Pathak, D Ramanan - Thirty-fifth conference on …, 2021 - openreview.net
Continual learning (CL) is widely regarded as crucial challenge for lifelong AI. However,
existing CL benchmarks, eg Permuted-MNIST and Split-CIFAR, make use of artificial …

A comprehensive empirical evaluation on online continual learning

A Soutif-Cormerais, A Carta, A Cossu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Online continual learning aims to get closer to a live learning experience by learning directly
on a stream of data with temporally shifting distribution and by storing a minimum amount of …

Clad: A realistic continual learning benchmark for autonomous driving

E Verwimp, K Yang, S Parisot, L Hong, S McDonagh… - Neural Networks, 2023 - Elsevier
In this paper we describe the design and the ideas motivating a new Continual Learning
benchmark for Autonomous Driving (CLAD), that focuses on the problems of object …

[PDF][PDF] Anomaly Detection in the Open World: Normality Shift Detection, Explanation, and Adaptation.

D Han, Z Wang, W Chen, K Wang, R Yu, S Wang… - NDSS, 2023 - ndss-symposium.org
Concept drift is one of the most frustrating challenges for learning-based security
applications built on the closeworld assumption of identical distribution between training and …

Clnerf: Continual learning meets nerf

Z Cai, M Müller - Proceedings of the IEEE/CVF International …, 2023 - openaccess.thecvf.com
Novel view synthesis aims to render unseen views given a set of calibrated images. In
practical applications, the coverage, appearance or geometry of the scene may change over …