Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges

ETM Beltrán, MQ Pérez, PMS Sánchez… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
In recent years, Federated Learning (FL) has gained relevance in training collaborative
models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the …

Federatedscope-llm: A comprehensive package for fine-tuning large language models in federated learning

W Kuang, B Qian, Z Li, D Chen, D Gao, X Pan… - Proceedings of the 30th …, 2024 - dl.acm.org
Large language models (LLMs) have demonstrated great capabilities in various natural
language understanding and generation tasks. These pre-trained LLMs can be further …

When foundation model meets federated learning: Motivations, challenges, and future directions

W Zhuang, C Chen, L Lyu - arxiv preprint arxiv:2306.15546, 2023 - arxiv.org
The intersection of the Foundation Model (FM) and Federated Learning (FL) provides mutual
benefits, presents a unique opportunity to unlock new possibilities in AI research, and …

Fedbiot: Llm local fine-tuning in federated learning without full model

F Wu, Z Li, Y Li, B Ding, J Gao - Proceedings of the 30th ACM SIGKDD …, 2024 - dl.acm.org
Large language models (LLMs) show amazing performance on many domain-specific tasks
after fine-tuning with some appropriate data. However, many domain-specific data are …

Federated learning: Overview, strategies, applications, tools and future directions

B Yurdem, M Kuzlu, MK Gullu, FO Catak, M Tabassum - Heliyon, 2024 - cell.com
Federated learning (FL) is a distributed machine learning process, which allows multiple
nodes to work together to train a shared model without exchanging raw data. It offers several …

Federatedscope-gnn: Towards a unified, comprehensive and efficient package for federated graph learning

Z Wang, W Kuang, Y **e, L Yao, Y Li, B Ding… - Proceedings of the 28th …, 2022 - dl.acm.org
The incredible development of federated learning (FL) has benefited various tasks in the
domains of computer vision and natural language processing, and the existing frameworks …

On the convergence of zeroth-order federated tuning for large language models

Z Ling, D Chen, L Yao, Y Li, Y Shen - Proceedings of the 30th ACM …, 2024 - dl.acm.org
The confluence of Federated Learning (FL) and Large Language Models (LLMs) is ushering
in a new era in privacy-preserving natural language processing. However, the intensive …

Efficient personalized federated learning via sparse model-adaptation

D Chen, L Yao, D Gao, B Ding… - … Conference on Machine …, 2023 - proceedings.mlr.press
Federated Learning (FL) aims to train machine learning models for multiple clients without
sharing their own private data. Due to the heterogeneity of clients' local data distribution …

Fs-real: Towards real-world cross-device federated learning

D Chen, D Gao, Y **e, X Pan, Z Li, Y Li, B Ding… - Proceedings of the 29th …, 2023 - dl.acm.org
Federated Learning (FL) aims to train high-quality models in collaboration with distributed
clients while not uploading their local data, which attracts increasing attention in both …

Revisiting personalized federated learning: Robustness against backdoor attacks

Z Qin, L Yao, D Chen, Y Li, B Ding… - Proceedings of the 29th …, 2023 - dl.acm.org
In this work, besides improving prediction accuracy, we study whether personalization could
bring robustness benefits to backdoor attacks. We conduct the first study of backdoor attacks …