When foundation model meets federated learning: Motivations, challenges, and future directions

W Zhuang, C Chen, L Lyu - arxiv preprint arxiv:2306.15546, 2023 - arxiv.org
The intersection of the Foundation Model (FM) and Federated Learning (FL) provides mutual
benefits, presents a unique opportunity to unlock new possibilities in AI research, and …

Rethinking data distillation: Do not overlook calibration

D Zhu, B Lei, J Zhang, Y Fang, Y **e… - Proceedings of the …, 2023 - openaccess.thecvf.com
Neural networks trained on distilled data often produce over-confident output and require
correction by calibration methods. Existing calibration methods such as temperature scaling …

MAS: Towards resource-efficient federated multiple-task learning

W Zhuang, Y Wen, L Lyu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Federated learning (FL) is an emerging distributed machine learning method that empowers
in-situ model training on decentralized edge devices. However, multiple simultaneous FL …

No one left behind: Real-world federated class-incremental learning

J Dong, H Li, Y Cong, G Sun, Y Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning (FL) is a hot collaborative training framework via aggregating model
parameters of decentralized local clients. However, most FL methods unreasonably assume …

Pilora: Prototype guided incremental lora for federated class-incremental learning

H Guo, F Zhu, W Liu, XY Zhang, CL Liu - European Conference on …, 2024 - Springer
Existing federated learning methods have effectively dealt with decentralized learning in
scenarios involving data privacy and non-IID data. However, in real-world situations, each …

Federated Class-Incremental Learning with Prototype Guided Transformer

H Guo, F Zhu, W Liu, XY Zhang, CL Liu - arxiv preprint arxiv:2401.02094, 2024 - arxiv.org
Existing federated learning methods have effectively addressed decentralized learning in
scenarios involving data privacy and non-IID data. However, in real-world situations, each …

Fedwon: Triumphing multi-domain federated learning without normalization

W Zhuang, L Lyu - The Twelfth International Conference on …, 2024 - openreview.net
Federated learning (FL) enhances data privacy with collaborative in-situ training on
decentralized clients. Nevertheless, FL encounters challenges due to non-independent and …

Is normalization indispensable for multi-domain federated learning?

W Zhuang, L Lyu - … Workshop on Federated Learning for Distributed …, 2023 - openreview.net
Federated learning (FL) enhances data privacy with collaborative in-situ training on
decentralized clients. Nevertheless, FL encounters challenges due to non-independent and …

Incremental Learning for Online Data Using QR Factorization on Convolutional Neural Networks

J Kim, WH Lee, S Baek, JH Hong, M Lee - Sensors, 2023 - mdpi.com
Catastrophic forgetting, which means a rapid forgetting of learned representations while
learning new data/samples, is one of the main problems of deep neural networks. In this …

Concept Matching: Clustering-based Federated Continual Learning

X Jiang, C Borcea - arxiv preprint arxiv:2311.06921, 2023 - arxiv.org
Federated Continual Learning (FCL) has emerged as a promising paradigm that combines
Federated Learning (FL) and Continual Learning (CL). To achieve good model accuracy …