Decentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges

ETM Beltrán, MQ Pérez, PMS Sánchez… - … Surveys & Tutorials, 2023 - ieeexplore.ieee.org
In recent years, Federated Learning (FL) has gained relevance in training collaborative
models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the …

Autonomous vehicles enabled by the integration of IoT, edge intelligence, 5G, and blockchain

A Biswas, HC Wang - Sensors, 2023 - mdpi.com
The wave of modernization around us has put the automotive industry on the brink of a
paradigm shift. Leveraging the ever-evolving technologies, vehicles are steadily …

Distributed learning in wireless networks: Recent progress and future challenges

M Chen, D Gündüz, K Huang, W Saad… - IEEE Journal on …, 2021 - ieeexplore.ieee.org
The next-generation of wireless networks will enable many machine learning (ML) tools and
applications to efficiently analyze various types of data collected by edge devices for …

Sparsity in deep learning: Pruning and growth for efficient inference and training in neural networks

T Hoefler, D Alistarh, T Ben-Nun, N Dryden… - Journal of Machine …, 2021 - jmlr.org
The growing energy and performance costs of deep learning have driven the community to
reduce the size of neural networks by selectively pruning components. Similarly to their …

From distributed machine learning to federated learning: A survey

J Liu, J Huang, Y Zhou, X Li, S Ji, H **ong… - … and Information Systems, 2022 - Springer
In recent years, data and computing resources are typically distributed in the devices of end
users, various regions or organizations. Because of laws or regulations, the distributed data …

Scaffold: Stochastic controlled averaging for federated learning

SP Karimireddy, S Kale, M Mohri… - International …, 2020 - proceedings.mlr.press
Federated learning is a key scenario in modern large-scale machine learning where the
data remains distributed over a large number of clients and the task is to learn a centralized …

Federated learning in mobile edge networks: A comprehensive survey

WYB Lim, NC Luong, DT Hoang, Y Jiao… - … surveys & tutorials, 2020 - ieeexplore.ieee.org
In recent years, mobile devices are equipped with increasingly advanced sensing and
computing capabilities. Coupled with advancements in Deep Learning (DL), this opens up …

Clustered federated learning: Model-agnostic distributed multitask optimization under privacy constraints

F Sattler, KR Müller, W Samek - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Federated learning (FL) is currently the most widely adopted framework for collaborative
training of (deep) machine learning models under privacy constraints. Albeit its popularity, it …

A unified theory of decentralized SGD with changing topology and local updates

A Koloskova, N Loizou, S Boreiri… - … on machine learning, 2020 - proceedings.mlr.press
Decentralized stochastic optimization methods have gained a lot of attention recently, mainly
because of their cheap per iteration cost, data locality, and their communication-efficiency. In …

On the convergence of fedavg on non-iid data

X Li, K Huang, W Yang, S Wang, Z Zhang - arxiv preprint arxiv …, 2019 - arxiv.org
Federated learning enables a large amount of edge computing devices to jointly learn a
model without data sharing. As a leading algorithm in this setting, Federated Averaging …