Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges
In recent years, Federated Learning (FL) has gained relevance in training collaborative
models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the …
models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the …
Convergence analysis of sequential federated learning on heterogeneous data
Y Li, X Lyu - Advances in Neural Information Processing …, 2024 - proceedings.neurips.cc
There are two categories of methods in Federated Learning (FL) for joint training across
multiple clients: i) parallel FL (PFL), where clients train models in a parallel manner; and ii) …
multiple clients: i) parallel FL (PFL), where clients train models in a parallel manner; and ii) …
Stochastic gradient descent under Markovian sampling schemes
M Even - International Conference on Machine Learning, 2023 - proceedings.mlr.press
We study a variation of vanilla stochastic gradient descent where the optimizer only has
access to a Markovian sampling scheme. These schemes encompass applications that …
access to a Markovian sampling scheme. These schemes encompass applications that …
Stability and generalization for markov chain stochastic gradient methods
Recently there is a large amount of work devoted to the study of Markov chain stochastic
gradient methods (MC-SGMs) which mainly focus on their convergence analysis for solving …
gradient methods (MC-SGMs) which mainly focus on their convergence analysis for solving …
Privacy amplification by decentralization
Analyzing data owned by several parties while achieving a good trade-off between utility
and privacy is a key challenge in federated learning and analytics. In this work, we introduce …
and privacy is a key challenge in federated learning and analytics. In this work, we introduce …
First order methods with markovian noise: from acceleration to variational inequalities
This paper delves into stochastic optimization problems that involve Markovian noise. We
present a unified approach for the theoretical analysis of first-order gradient methods for …
present a unified approach for the theoretical analysis of first-order gradient methods for …
On the decentralized stochastic gradient descent with markov chain sampling
The decentralized stochastic gradient method emerges as a promising solution for solving
large-scale machine learning problems. This paper studies the decentralized Markov chain …
large-scale machine learning problems. This paper studies the decentralized Markov chain …
Fed-ensemble: Ensemble models in federated learning for improved generalization and uncertainty quantification
The increase in the computational power of edge devices has opened up the possibility of
processing some of the data at the edge and distributing model learning. This paradigm is …
processing some of the data at the edge and distributing model learning. This paradigm is …
Two-stage community energy trading under end-edge-cloud orchestration
The end-edge-cloud orchestration of the virtual power plant (VPP) enables the edge server
to timely serve community users. By deploying the community energy storage system …
to timely serve community users. By deploying the community energy storage system …
Fully decentralized federated learning-based on-board mission for UAV swarm system
To handle the data explosion in the era of Internet-of-things, it is of interest to investigate the
decentralized network, with the aim at relaxing the burden at the central server along with …
decentralized network, with the aim at relaxing the burden at the central server along with …