[HTML][HTML] Managing the unknown in machine learning: Definitions, related areas, recent advances, and prospects

M Barcina-Blanco, JL Lobo, P Garcia-Bringas… - Neurocomputing, 2024 - Elsevier
In the rapidly evolving domain of machine learning, the ability to adapt to unforeseen
circumstances and novel data types is of paramount importance. The deployment of Artificial …

Analyzing and reducing catastrophic forgetting in parameter efficient tuning

W Ren, X Li, L Wang, T Zhao, W Qin - arxiv preprint arxiv:2402.18865, 2024 - arxiv.org
Existing research has shown that large language models (LLMs) exhibit remarkable
performance in language understanding and generation. However, when LLMs are …

Online task-free continual generative and discriminative learning via dynamic cluster memory

F Ye, AG Bors - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
Abstract Online Task-Free Continual Learning (OTFCL) aims to learn novel concepts from
streaming data without accessing task information. Most memory-based approaches used in …

Class incremental learning with multi-teacher distillation

H Wen, L Pan, Y Dai, H Qiu, L Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Distillation strategies are currently the primary approaches for mitigating forgetting in class
incremental learning (CIL). Existing methods generally inherit previous knowledge from a …

Addressing loss of plasticity and catastrophic forgetting in continual learning

M Elsayed, AR Mahmood - arxiv preprint arxiv:2404.00781, 2024 - arxiv.org
Deep representation learning methods struggle with continual learning, suffering from both
catastrophic forgetting of useful units and loss of plasticity, often due to rigid and unuseful …

Defense without forgetting: Continual adversarial defense with anisotropic & isotropic pseudo replay

Y Zhou, Z Hua - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
Deep neural networks have demonstrated susceptibility to adversarial attacks. Adversarial
defense techniques often focus on one-shot setting to maintain robustness against attack …

Adapt your teacher: Improving knowledge distillation for exemplar-free continual learning

F Szatkowski, M Pyla… - Proceedings of the …, 2024 - openaccess.thecvf.com
In this work, we investigate exemplar-free class incremental learning (CIL) with knowledge
distillation (KD) as a regularization strategy, aiming to prevent forgetting. KD-based methods …

Towards General Industrial Intelligence: A Survey on IIoT-Enhanced Continual Large Models

J Chen, J He, F Chen, Z Lv, J Tang, W Li, Z Liu… - arxiv preprint arxiv …, 2024 - arxiv.org
Currently, most applications in the Industrial Internet of Things (IIoT) still rely on CNN-based
neural networks. Although Transformer-based large models (LMs), including language …

Continual audio-visual sound separation

W Pian, Y Nan, S Deng, S Mo… - Advances in Neural …, 2025 - proceedings.neurips.cc
In this paper, we introduce a novel continual audio-visual sound separation task, aiming to
continuously separate sound sources for new classes while preserving performance on …

Continual Learning for Remote Physiological Measurement: Minimize Forgetting and Simplify Inference

Q Liang, Y Chen, Y Hu - European conference on computer vision, 2024 - Springer
Remote photoplethysmography (rPPG) has gained significant attention in recent years for its
ability to extract physiological signals from facial videos. While existing rPPG measurement …