Topology-aware federated learning in edge computing: A comprehensive survey

J Wu, F Dong, H Leung, Z Zhu, J Zhou… - ACM Computing …, 2024 - dl.acm.org
The ultra-low latency requirements of 5G/6G applications and privacy constraints call for
distributed machine learning systems to be deployed at the edge. With its simple yet …

Communication and computation efficiency in federated learning: A survey

ORA Almanifi, CO Chow, ML Tham, JH Chuah… - Internet of Things, 2023 - Elsevier
Federated Learning is a much-needed technology in this golden era of big data and Artificial
Intelligence, due to its vital role in preserving data privacy, and eliminating the need to …

Topology-aware generalization of decentralized sgd

T Zhu, F He, L Zhang, Z Niu… - … on Machine Learning, 2022 - proceedings.mlr.press
This paper studies the algorithmic stability and generalizability of decentralized stochastic
gradient descent (D-SGD). We prove that the consensus model learned by D-SGD is …

Demystifying why local aggregation helps: Convergence analysis of hierarchical SGD

J Wang, S Wang, RR Chen, M Ji - … of the AAAI Conference on Artificial …, 2022 - ojs.aaai.org
Abstract Hierarchical SGD (H-SGD) has emerged as a new distributed SGD algorithm for
multi-level communication networks. In H-SGD, before each global aggregation, workers …

Towards effective clustered federated learning: A peer-to-peer framework with adaptive neighbor matching

Z Li, J Lu, S Luo, D Zhu, Y Shao, Y Li… - … Transactions on Big …, 2022 - ieeexplore.ieee.org
In federated learning (FL), clients may have diverse objectives, and merging all clients'
knowledge into one global model will cause negative transfer to local performance. Thus …

FedUC: A unified clustering approach for hierarchical federated learning

Q Ma, Y Xu, H Xu, J Liu, L Huang - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Federated learning (FL) is an effective approach to train models collaboratively among
distributed edge nodes (ie, workers) while facing three crucial challenges, edge …

Robust communication-efficient decentralized learning with heterogeneity

X Zhang, Y Wang, S Chen, C Wang, D Yu… - Journal of Systems …, 2023 - Elsevier
In this paper, we propose a robust communication-efficient decentralized learning algorithm,
named RCEDL, to address data heterogeneity, communication heterogeneity and …

MoDeST: Bridging the Gap between Federated and Decentralized Learning with Decentralized Sampling

M de Vos, A Dhasade, AM Kermarrec, E Lavoie… - arxiv preprint arxiv …, 2023 - arxiv.org
Federated and decentralized machine learning leverage end-user devices for privacy-
preserving training of models at lower operating costs than within a data center. In a round of …

Reducing Non-IID Effects in Federated Autonomous Driving with Contrastive Divergence Loss

T Do, BX Nguyen, QD Tran, H Nguyen… - … on Robotics and …, 2024 - ieeexplore.ieee.org
Federated learning has been widely applied in autonomous driving since it enables training
a learning model among vehicles without sharing users' data. However, data from …

Introducing Federated Learning into Internet of Things Ecosystems–Maintaining Cooperation Between Competing Parties

K Bogacka, A Danilenka… - … Conference on Big Data …, 2022 - Springer
In practical realizations of a Federated Learning ecosystems, the parties cooperating during
the training process, and that later use the trained/global model may consist of competing …