Advancements in federated learning: Models, methods, and privacy

H Chen, H Wang, Q Long, D **, Y Li - ACM Computing Surveys, 2024 - dl.acm.org
Federated learning (FL) is a promising technique for resolving the rising privacy and security
concerns. Its main ingredient is to cooperatively learn the model among the distributed …

FedGH: Heterogeneous federated learning with generalized global header

L Yi, G Wang, X Liu, Z Shi, H Yu - Proceedings of the 31st ACM …, 2023 - dl.acm.org
Federated learning (FL) is an emerging machine learning paradigm that allows multiple
parties to train a shared model collaboratively in a privacy-preserving manner. Existing …

Complex QA and language models hybrid architectures, Survey

X Daull, P Bellot, E Bruno, V Martin… - arxiv preprint arxiv …, 2023 - arxiv.org
This paper reviews the state-of-the-art of language models architectures and strategies for"
complex" question-answering (QA, CQA, CPS) with a focus on hybridization. Large …

Fedlora: Model-heterogeneous personalized federated learning with lora tuning

L Yi, H Yu, G Wang, X Liu - arxiv preprint arxiv:2310.13283, 2023 - arxiv.org
Federated learning (FL) is an emerging machine learning paradigm in which a central
server coordinates multiple participants (aka FL clients) to train a model collaboratively on …

Client-customized adaptation for parameter-efficient federated learning

Y Kim, J Kim, WL Mok, JH Park… - Findings of the …, 2023 - aclanthology.org
Despite the versatility of pre-trained language models (PLMs) across domains, their large
memory footprints pose significant challenges in federated learning (FL), where the training …

Corpusbrain++: A continual generative pre-training framework for knowledge-intensive language tasks

J Guo, C Zhou, R Zhang, J Chen, M de Rijke… - arxiv preprint arxiv …, 2024 - arxiv.org
Knowledge-intensive language tasks (KILTs) typically require retrieving relevant documents
from trustworthy corpora, eg, Wikipedia, to produce specific answers. Very recently, a pre …

Pretrained models for multilingual federated learning

O Weller, M Marone, V Braverman, D Lawrie… - arxiv preprint arxiv …, 2022 - arxiv.org
Since the advent of Federated Learning (FL), research has applied these methods to natural
language processing (NLP) tasks. Despite a plethora of papers in FL for NLP, no previous …

Tunable soft prompts are messengers in federated learning

C Dong, Y **e, B Ding, Y Shen, Y Li - arxiv preprint arxiv:2311.06805, 2023 - arxiv.org
Federated learning (FL) enables multiple participants to collaboratively train machine
learning models using decentralized data sources, alleviating privacy concerns that arise …

[PDF][PDF] Dual calibration-based personalised federated learning

X Tang, H Yu, R Tang, C Ren, A Li, X Li - Proceedings of the Thirty-Third …, 2024 - ijcai.org
Personalized federated learning (PFL) is designed for scenarios with non-independent and
identically distributed (non-IID) client data. Existing model mixup-based methods, one of the …

FedSSA: Semantic similarity-based aggregation for efficient model-heterogeneous personalized federated learning

L Yi, H Yu, Z Shi, G Wang, X Liu, L Cui, X Li - arxiv preprint arxiv …, 2023 - arxiv.org
Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm.
Traditional FL requires all data owners (aka FL clients) to train the same local model. This …