Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges

ETM Beltrán, MQ Pérez, PMS Sánchez… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
In recent years, Federated Learning (FL) has gained relevance in training collaborative
models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the …

Convergence analysis of sequential federated learning on heterogeneous data

Y Li, X Lyu - Advances in Neural Information Processing …, 2024 - proceedings.neurips.cc
There are two categories of methods in Federated Learning (FL) for joint training across
multiple clients: i) parallel FL (PFL), where clients train models in a parallel manner; and ii) …

Stochastic gradient descent under Markovian sampling schemes

M Even - International Conference on Machine Learning, 2023 - proceedings.mlr.press
We study a variation of vanilla stochastic gradient descent where the optimizer only has
access to a Markovian sampling scheme. These schemes encompass applications that …

Stability and generalization for markov chain stochastic gradient methods

P Wang, Y Lei, Y Ying, DX Zhou - Advances in Neural …, 2022 - proceedings.neurips.cc
Recently there is a large amount of work devoted to the study of Markov chain stochastic
gradient methods (MC-SGMs) which mainly focus on their convergence analysis for solving …

Privacy amplification by decentralization

E Cyffers, A Bellet - International Conference on Artificial …, 2022 - proceedings.mlr.press
Analyzing data owned by several parties while achieving a good trade-off between utility
and privacy is a key challenge in federated learning and analytics. In this work, we introduce …

First order methods with markovian noise: from acceleration to variational inequalities

A Beznosikov, S Samsonov… - Advances in …, 2024 - proceedings.neurips.cc
This paper delves into stochastic optimization problems that involve Markovian noise. We
present a unified approach for the theoretical analysis of first-order gradient methods for …

On the decentralized stochastic gradient descent with markov chain sampling

T Sun, D Li, B Wang - IEEE Transactions on Signal Processing, 2023 - ieeexplore.ieee.org
The decentralized stochastic gradient method emerges as a promising solution for solving
large-scale machine learning problems. This paper studies the decentralized Markov chain …

Fed-ensemble: Ensemble models in federated learning for improved generalization and uncertainty quantification

N Shi, F Lai, R Al Kontar… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The increase in the computational power of edge devices has opened up the possibility of
processing some of the data at the edge and distributing model learning. This paradigm is …

Two-stage community energy trading under end-edge-cloud orchestration

X Li, C Li, X Liu, G Chen… - IEEE Internet of Things …, 2022 - ieeexplore.ieee.org
The end-edge-cloud orchestration of the virtual power plant (VPP) enables the edge server
to timely serve community users. By deploying the community energy storage system …

Fully decentralized federated learning-based on-board mission for UAV swarm system

Y **ao, Y Ye, S Huang, L Hao, Z Ma… - IEEE …, 2021 - ieeexplore.ieee.org
To handle the data explosion in the era of Internet-of-things, it is of interest to investigate the
decentralized network, with the aim at relaxing the burden at the central server along with …