Heterogeneous federated learning: State-of-the-art and research challenges

M Ye, X Fang, B Du, PC Yuen, D Tao - ACM Computing Surveys, 2023 - dl.acm.org
Federated learning (FL) has drawn increasing attention owing to its potential use in large-
scale industrial applications. Existing FL works mainly focus on model homogeneous …

A comprehensive survey of federated transfer learning: challenges, methods and applications

W Guo, F Zhuang, X Zhang, Y Tong, J Dong - Frontiers of Computer …, 2024 - Springer
Federated learning (FL) is a novel distributed machine learning paradigm that enables
participants to collaboratively train a centralized model with privacy preservation by …

Learn from others and be yourself in heterogeneous federated learning

W Huang, M Ye, B Du - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
Federated learning has emerged as an important distributed learning paradigm, which
normally involves collaborative updating with others and local updating on private data …

Model-contrastive federated learning

Q Li, B He, D Song - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
Federated learning enables multiple parties to collaboratively train a machine learning
model without communicating their local data. A key challenge in federated learning is to …

Federated learning from pre-trained models: A contrastive learning approach

Y Tan, G Long, J Ma, L Liu, T Zhou… - Advances in neural …, 2022 - proceedings.neurips.cc
Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to
learn collaboratively without sharing their private data. However, excessive computation and …

Fedproc: Prototypical contrastive federated learning on non-iid data

X Mu, Y Shen, K Cheng, X Geng, J Fu, T Zhang… - Future Generation …, 2023 - Elsevier
Federated learning (FL) enables multiple clients to jointly train high-performance deep
learning models while maintaining the training data locally. However, it is challenging to …

Collaborative unsupervised visual representation learning from decentralized data

W Zhuang, X Gan, Y Wen… - Proceedings of the …, 2021 - openaccess.thecvf.com
Unsupervised representation learning has achieved outstanding performances using
centralized data available on the Internet. However, the increasing awareness of privacy …

Divergence-aware federated self-supervised learning

W Zhuang, Y Wen, S Zhang - arxiv preprint arxiv:2204.04385, 2022 - arxiv.org
Self-supervised learning (SSL) is capable of learning remarkable representations from
centrally available data. Recent works further implement federated learning with SSL to …

Fedavg with fine tuning: Local updates lead to representation learning

L Collins, H Hassani, A Mokhtari… - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract The Federated Averaging (FedAvg) algorithm, which consists of alternating
between a few local stochastic gradient updates at client nodes, followed by a model …

Label-efficient self-supervised federated learning for tackling data heterogeneity in medical imaging

R Yan, L Qu, Q Wei, SC Huang, L Shen… - … on Medical Imaging, 2023 - ieeexplore.ieee.org
The collection and curation of large-scale medical datasets from multiple institutions is
essential for training accurate deep learning models, but privacy concerns often hinder data …