Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges

ETM Beltrán, MQ Pérez, PMS Sánchez… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
In recent years, Federated Learning (FL) has gained relevance in training collaborative
models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the …

Byzantine machine learning: A primer

R Guerraoui, N Gupta, R Pinot - ACM Computing Surveys, 2024 - dl.acm.org
The problem of Byzantine resilience in distributed machine learning, aka Byzantine machine
learning, consists of designing distributed algorithms that can train an accurate model …

Topology-aware generalization of decentralized sgd

T Zhu, F He, L Zhang, Z Niu… - … on Machine Learning, 2022 - proceedings.mlr.press
This paper studies the algorithmic stability and generalizability of decentralized stochastic
gradient descent (D-SGD). We prove that the consensus model learned by D-SGD is …

Fedcs: Efficient communication scheduling in decentralized federated learning

R Zong, Y Qin, F Wu, Z Tang, K Li - Information Fusion, 2024 - Elsevier
Decentralized federated learning is a training approach that prioritizes user data privacy
protection, while also offering improved scalability and robustness. However, as the number …

Refined convergence and topology learning for decentralized sgd with heterogeneous data

B Le Bars, A Bellet, M Tommasi… - International …, 2023 - proceedings.mlr.press
One of the key challenges in decentralized and federated learning is to design algorithms
that efficiently deal with highly heterogeneous data distributions across agents. In this paper …

DeFTA: A plug-and-play peer-to-peer decentralized federated learning framework

Y Zhou, M Shi, Y Tian, Q Ye, J Lv - Information Sciences, 2024 - Elsevier
Federated learning (FL) is a pivotal catalyst for enabling large-scale privacy-preserving
distributed machine learning (ML). By eliminating the need for local raw dataset sharing, FL …

Deprl: Achieving linear convergence speedup in personalized decentralized learning with shared representations

G **ong, G Yan, S Wang, J Li - Proceedings of the AAAI Conference on …, 2024 - ojs.aaai.org
Decentralized learning has emerged as an alternative method to the popular parameter-
server framework which suffers from high communication burden, single-point failure and …

Knowledge distillation and training balance for heterogeneous decentralized multi-modal learning over wireless networks

B Yin, Z Chen, M Tao - IEEE Transactions on Mobile Computing, 2024 - ieeexplore.ieee.org
Decentralized learning is widely employed for collaboratively training models using
distributed data over wireless networks. Existing decentralized learning methods primarily …

Review of Mathematical Optimization in Federated Learning

S Yang, F Zhao, Z Zhou, L Shi, X Ren, Z Xu - arxiv preprint arxiv …, 2024 - arxiv.org
Federated Learning (FL) has been becoming a popular interdisciplinary research area in
both applied mathematics and information sciences. Mathematically, FL aims to …

Structured cooperative learning with graphical model priors

S Li, T Zhou, X Tian, D Tao - International Conference on …, 2023 - proceedings.mlr.press
We study how to train personalized models for different tasks on decentralized devices with
limited local data. We propose" Structured Cooperative Learning (SCooL)", in which a …