Is heterogeneity notorious? taming heterogeneity to handle test-time shift in federated learning

Y Tan, C Chen, W Zhuang, X Dong… - Advances in Neural …, 2023 - proceedings.neurips.cc
Federated learning (FL) is an effective machine learning paradigm where multiple clients
can train models based on heterogeneous data in a decentralized manner without …

[PDF][PDF] Federated Probabilistic Preference Distribution Modelling with Compactness Co-Clustering for Privacy-Preserving Multi-Domain Recommendation.

W Liu, C Chen, X Liao, M Hu, J Yin, Y Tan, L Zheng - IJCAI, 2023 - ijcai.org
With the development of modern internet techniques, Cross-Domain Recommendation
(CDR) systems have been widely exploited for tackling the data-sparsity problem …

Learning to generate image embeddings with user-level differential privacy

Z Xu, M Collins, Y Wang, L Panait… - Proceedings of the …, 2023 - openaccess.thecvf.com
Small on-device models have been successfully trained with user-level differential privacy
(DP) for next word prediction and image classification tasks in the past. However, existing …

Communication Efficiency and Non-Independent and Identically Distributed Data Challenge in Federated Learning: A Systematic Map** Study

B Alotaibi, FA Khan, S Mahmood - Applied Sciences, 2024 - mdpi.com
Federated learning has emerged as a promising approach for collaborative model training
across distributed devices. Federated learning faces challenges such as Non-Independent …

Fedimpro: Measuring and improving client update in federated learning

Z Tang, Y Zhang, S Shi, X Tian, T Liu, B Han… - arxiv preprint arxiv …, 2024 - arxiv.org
Federated Learning (FL) models often experience client drift caused by heterogeneous data,
where the distribution of data differs across clients. To address this issue, advanced …

Dlora: Distributed parameter-efficient fine-tuning solution for large language model

C Gao, SQ Zhang - arxiv preprint arxiv:2404.05182, 2024 - arxiv.org
To enhance the performance of large language models (LLM) on downstream tasks, one
solution is to fine-tune certain LLM parameters and make it better align with the …

Federated learning in computer vision

D Shenaj, G Rizzoli, P Zanuttigh - Ieee Access, 2023 - ieeexplore.ieee.org
Federated Learning (FL) has recently emerged as a novel machine learning paradigm
allowing to preserve privacy and to account for the distributed nature of the learning process …

Protofl: Unsupervised federated learning via prototypical distillation

H Kim, Y Kwak, M Jung, J Shin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Federated learning (FL) is a promising approach for enhancing data privacy preservation,
particularly for authentication systems. However, limited round communications, scarce …

HyperFed: hyperbolic prototypes exploration with consistent aggregation for non-IID data in federated learning

X Liao, W Liu, C Chen, P Zhou, H Zhu, Y Tan… - arxiv preprint arxiv …, 2023 - arxiv.org
Federated learning (FL) collaboratively models user data in a decentralized way. However,
in the real world, non-identical and independent data distributions (non-IID) among clients …

Coala: A practical and vision-centric federated learning platform

W Zhuang, J Xu, C Chen, J Li, L Lyu - arxiv preprint arxiv:2407.16560, 2024 - arxiv.org
We present COALA, a vision-centric Federated Learning (FL) platform, and a suite of
benchmarks for practical FL scenarios, which we categorize into three levels: task, data, and …