Federated learning for computationally constrained heterogeneous devices: A survey

K Pfeiffer, M Rapp, R Khalili, J Henkel - ACM Computing Surveys, 2023 - dl.acm.org
With an increasing number of smart devices like internet of things devices deployed in the
field, offloading training of neural networks (NNs) to a central server becomes more and …

A comprehensive survey of federated transfer learning: challenges, methods and applications

W Guo, F Zhuang, X Zhang, Y Tong, J Dong - Frontiers of Computer …, 2024 - Springer
Federated learning (FL) is a novel distributed machine learning paradigm that enables
participants to collaboratively train a centralized model with privacy preservation by …

Every parameter matters: Ensuring the convergence of federated learning with dynamic heterogeneous models reduction

H Zhou, T Lan, GP Venkataramani… - Advances in Neural …, 2024 - proceedings.neurips.cc
Abstract Cross-device Federated Learning (FL) faces significant challenges where low-end
clients that could potentially make unique contributions are excluded from training large …

FedGH: Heterogeneous federated learning with generalized global header

L Yi, G Wang, X Liu, Z Shi, H Yu - Proceedings of the 31st ACM …, 2023 - dl.acm.org
Federated learning (FL) is an emerging machine learning paradigm that allows multiple
parties to train a shared model collaboratively in a privacy-preserving manner. Existing …

SLoRA: Federated parameter efficient fine-tuning of language models

S Babakniya, AR Elkordy, YH Ezzeldin, Q Liu… - arxiv preprint arxiv …, 2023 - arxiv.org
Transfer learning via fine-tuning pre-trained transformer models has gained significant
success in delivering state-of-the-art results across various NLP tasks. In the absence of …

Fedlora: Model-heterogeneous personalized federated learning with lora tuning

L Yi, H Yu, G Wang, X Liu - arxiv preprint arxiv:2310.13283, 2023 - arxiv.org
Federated learning (FL) is an emerging machine learning paradigm in which a central
server coordinates multiple participants (aka FL clients) to train a model collaboratively on …

Is aggregation the only choice? federated learning via layer-wise model recombination

M Hu, Z Yue, X **e, C Chen, Y Huang, X Wei… - Proceedings of the 30th …, 2024 - dl.acm.org
Although Federated Learning (FL) enables global model training across clients without
compromising their raw data, due to the unevenly distributed data among clients, existing …

Gpt-fl: Generative pre-trained model-assisted federated learning

T Zhang, T Feng, S Alam, D Dimitriadis, S Lee… - arxiv preprint arxiv …, 2023 - arxiv.org
In this work, we propose GPT-FL, a generative pre-trained model-assisted federated
learning (FL) framework. At its core, GPT-FL leverages generative pre-trained models to …

Timelyfl: Heterogeneity-aware asynchronous federated learning with adaptive partial training

T Zhang, L Gao, S Lee, M Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract In cross-device Federated Learning (FL) environments, scaling synchronous FL
methods is challenging as stragglers hinder the training process. Moreover, the availability …

Agglomerative federated learning: Empowering larger model training via end-edge-cloud collaboration

Z Wu, S Sun, Y Wang, M Liu, B Gao… - … -IEEE Conference on …, 2024 - ieeexplore.ieee.org
Federated Learning (FL) enables training Artificial Intelligence (AI) models over end devices
without compromising their privacy. As computing tasks are increasingly performed by a …