Expandable subspace ensemble for pre-trained model-based class-incremental learning

DW Zhou, HL Sun, HJ Ye… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Class-Incremental Learning (CIL) requires a learning system to continually learn
new classes without forgetting. Despite the strong performance of Pre-Trained Models …

Continual learning with pre-trained models: A survey

DW Zhou, HL Sun, J Ning, HJ Ye, DC Zhan - arxiv preprint arxiv …, 2024 - arxiv.org
Nowadays, real-world applications often face streaming data, which requires the learning
system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve …

Class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Calibrating higher-order statistics for few-shot class-incremental learning with pre-trained vision transformers

D Goswami, B Twardowski… - Proceedings of the …, 2024 - openaccess.thecvf.com
Few-shot class-incremental learning (FSCIL) aims to adapt the model to new classes from
very few data (5 samples) without forgetting the previously learned classes. Recent works in …

Exemplar-free continual representation learning via learnable drift compensation

A Gomez-Villa, D Goswami, K Wang… - … on Computer Vision, 2024 - Springer
Exemplar-free class-incremental learning using a backbone trained from scratch and
starting from a small first task presents a significant challenge for continual representation …

Beyond prompt learning: Continual adapter for efficient rehearsal-free continual learning

X Gao, S Dong, Y He, Q Wang, Y Gong - European Conference on …, 2024 - Springer
Abstract The problem of Rehearsal-Free Continual Learning (RFCL) aims to continually
learn new knowledge while preventing forgetting of the old knowledge, without storing any …

Online Analytic Exemplar-Free Continual Learning with Large Models for Imbalanced Autonomous Driving Task

H Zhuang, D Fang, K Tong, Y Liu… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
In autonomous driving, even a meticulously trained model can encounter failures when
facing unfamiliar scenarios. One of these scenarios can be formulated as an online …

Weighted ensemble models are strong continual learners

IE Marouf, S Roy, E Tartaglione… - European Conference on …, 2024 - Springer
In this work, we study the problem of continual learning (CL) where the goal is to learn a
model on a sequence of tasks, under the assumption that the data from the previous tasks …

Class-incremental learning with clip: Adaptive representation adjustment and parameter fusion

L Huang, X Cao, H Lu, X Liu - European Conference on Computer Vision, 2024 - Springer
Class-incremental learning is a challenging problem, where the goal is to train a model that
can classify data from an increasing number of classes over time. With the advancement of …

Towards General Industrial Intelligence: A Survey on IIoT-Enhanced Continual Large Models

J Chen, J He, F Chen, Z Lv, J Tang, W Li, Z Liu… - arxiv preprint arxiv …, 2024 - arxiv.org
Currently, most applications in the Industrial Internet of Things (IIoT) still rely on CNN-based
neural networks. Although Transformer-based large models (LMs), including language …