Advancements in federated learning: Models, methods, and privacy
Federated learning (FL) is a promising technique for resolving the rising privacy and security
concerns. Its main ingredient is to cooperatively learn the model among the distributed …
concerns. Its main ingredient is to cooperatively learn the model among the distributed …
FedGH: Heterogeneous federated learning with generalized global header
Federated learning (FL) is an emerging machine learning paradigm that allows multiple
parties to train a shared model collaboratively in a privacy-preserving manner. Existing …
parties to train a shared model collaboratively in a privacy-preserving manner. Existing …
Complex QA and language models hybrid architectures, Survey
This paper reviews the state-of-the-art of language models architectures and strategies for"
complex" question-answering (QA, CQA, CPS) with a focus on hybridization. Large …
complex" question-answering (QA, CQA, CPS) with a focus on hybridization. Large …
Fedlora: Model-heterogeneous personalized federated learning with lora tuning
Federated learning (FL) is an emerging machine learning paradigm in which a central
server coordinates multiple participants (aka FL clients) to train a model collaboratively on …
server coordinates multiple participants (aka FL clients) to train a model collaboratively on …
Client-customized adaptation for parameter-efficient federated learning
Despite the versatility of pre-trained language models (PLMs) across domains, their large
memory footprints pose significant challenges in federated learning (FL), where the training …
memory footprints pose significant challenges in federated learning (FL), where the training …
Corpusbrain++: A continual generative pre-training framework for knowledge-intensive language tasks
Knowledge-intensive language tasks (KILTs) typically require retrieving relevant documents
from trustworthy corpora, eg, Wikipedia, to produce specific answers. Very recently, a pre …
from trustworthy corpora, eg, Wikipedia, to produce specific answers. Very recently, a pre …
Pretrained models for multilingual federated learning
Since the advent of Federated Learning (FL), research has applied these methods to natural
language processing (NLP) tasks. Despite a plethora of papers in FL for NLP, no previous …
language processing (NLP) tasks. Despite a plethora of papers in FL for NLP, no previous …
Tunable soft prompts are messengers in federated learning
Federated learning (FL) enables multiple participants to collaboratively train machine
learning models using decentralized data sources, alleviating privacy concerns that arise …
learning models using decentralized data sources, alleviating privacy concerns that arise …
[PDF][PDF] Dual calibration-based personalised federated learning
Personalized federated learning (PFL) is designed for scenarios with non-independent and
identically distributed (non-IID) client data. Existing model mixup-based methods, one of the …
identically distributed (non-IID) client data. Existing model mixup-based methods, one of the …
FedSSA: Semantic similarity-based aggregation for efficient model-heterogeneous personalized federated learning
Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm.
Traditional FL requires all data owners (aka FL clients) to train the same local model. This …
Traditional FL requires all data owners (aka FL clients) to train the same local model. This …