Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges

ETM Beltrán, MQ Pérez, PMS Sánchez… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
In recent years, Federated Learning (FL) has gained relevance in training collaborative
models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the …

Stochastic gradient descent under Markovian sampling schemes

M Even - International Conference on Machine Learning, 2023 - proceedings.mlr.press
We study a variation of vanilla stochastic gradient descent where the optimizer only has
access to a Markovian sampling scheme. These schemes encompass applications that …

Convergence analysis of sequential federated learning on heterogeneous data

Y Li, X Lyu - Advances in Neural Information Processing …, 2023 - proceedings.neurips.cc
There are two categories of methods in Federated Learning (FL) for joint training across
multiple clients: i) parallel FL (PFL), where clients train models in a parallel manner; and ii) …

First order methods with markovian noise: from acceleration to variational inequalities

A Beznosikov, S Samsonov… - Advances in …, 2023 - proceedings.neurips.cc
This paper delves into stochastic optimization problems that involve Markovian noise. We
present a unified approach for the theoretical analysis of first-order gradient methods for …

Privacy amplification by decentralization

E Cyffers, A Bellet - International Conference on Artificial …, 2022 - proceedings.mlr.press
Analyzing data owned by several parties while achieving a good trade-off between utility
and privacy is a key challenge in federated learning and analytics. In this work, we introduce …

Stability and generalization for markov chain stochastic gradient methods

P Wang, Y Lei, Y Ying, DX Zhou - Advances in Neural …, 2022 - proceedings.neurips.cc
Recently there is a large amount of work devoted to the study of Markov chain stochastic
gradient methods (MC-SGMs) which mainly focus on their convergence analysis for solving …

Fed-ensemble: Ensemble models in federated learning for improved generalization and uncertainty quantification

N Shi, F Lai, R Al Kontar… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The increase in the computational power of edge devices has opened up the possibility of
processing some of the data at the edge and distributing model learning. This paradigm is …

Adaptive random walk gradient descent for decentralized optimization

T Sun, D Li, B Wang - International conference on machine …, 2022 - proceedings.mlr.press
In this paper, we study the adaptive step size random walk gradient descent with momentum
for decentralized optimization, in which the training samples are drawn dependently with …

Fully decentralized federated learning-based on-board mission for UAV swarm system

Y **ao, Y Ye, S Huang, L Hao, Z Ma… - IEEE …, 2021 - ieeexplore.ieee.org
To handle the data explosion in the era of Internet-of-things, it is of interest to investigate the
decentralized network, with the aim at relaxing the burden at the central server along with …

From noisy fixed-point iterations to private ADMM for centralized and federated learning

E Cyffers, A Bellet, D Basu - International Conference on …, 2023 - proceedings.mlr.press
We study differentially private (DP) machine learning algorithms as instances of noisy fixed-
point iterations, in order to derive privacy and utility results from this well-studied framework …