Distributed artificial intelligence empowered by end-edge-cloud computing: A survey

S Duan, D Wang, J Ren, F Lyu, Y Zhang… - … Surveys & Tutorials, 2022‏ - ieeexplore.ieee.org
As the computing paradigm shifts from cloud computing to end-edge-cloud computing, it
also supports artificial intelligence evolving from a centralized manner to a distributed one …

A survey on federated learning for resource-constrained IoT devices

A Imteaj, U Thakker, S Wang, J Li… - IEEE Internet of Things …, 2021‏ - ieeexplore.ieee.org
Federated learning (FL) is a distributed machine learning strategy that generates a global
model by learning from multiple decentralized edge clients. FL enables on-device training …

Federated learning with buffered asynchronous aggregation

J Nguyen, K Malik, H Zhan… - International …, 2022‏ - proceedings.mlr.press
Scalability and privacy are two critical concerns for cross-device federated learning (FL)
systems. In this work, we identify that synchronous FL–cannot scale efficiently beyond a few …

Convergence of edge computing and deep learning: A comprehensive survey

X Wang, Y Han, VCM Leung, D Niyato… - … surveys & tutorials, 2020‏ - ieeexplore.ieee.org
Ubiquitous sensors and smart devices from factories and communities are generating
massive amounts of data, and ever-increasing computing power is driving the core of …

The right to be forgotten in federated learning: An efficient realization with rapid retraining

Y Liu, L Xu, X Yuan, C Wang, B Li - IEEE INFOCOM 2022-IEEE …, 2022‏ - ieeexplore.ieee.org
In Machine Learning, the emergence of the right to be forgotten gave birth to a paradigm
named machine unlearning, which enables data holders to proactively erase their data from …

Asynchronous federated optimization

C **e, S Koyejo, I Gupta - arxiv preprint arxiv:1903.03934, 2019‏ - arxiv.org
Federated learning enables training on a massive number of edge devices. To improve
flexibility and scalability, we propose a new asynchronous federated optimization algorithm …

Adaptive federated learning in resource constrained edge computing systems

S Wang, T Tuor, T Salonidis, KK Leung… - IEEE journal on …, 2019‏ - ieeexplore.ieee.org
Emerging technologies and applications including Internet of Things, social networking, and
crowd-sourcing generate large amounts of data at the network edge. Machine learning …

Sharper convergence guarantees for asynchronous SGD for distributed and federated learning

A Koloskova, SU Stich, M Jaggi - Advances in Neural …, 2022‏ - proceedings.neurips.cc
We study the asynchronous stochastic gradient descent algorithm, for distributed training
over $ n $ workers that might be heterogeneous. In this algorithm, workers compute …

SAFA: A semi-asynchronous protocol for fast federated learning with low overhead

W Wu, L He, W Lin, R Mao, C Maple… - IEEE Transactions on …, 2020‏ - ieeexplore.ieee.org
Federated learning (FL) has attracted increasing attention as a promising approach to
driving a vast number of end devices with artificial intelligence. However, it is very …

Cocktailsgd: Fine-tuning foundation models over 500mbps networks

J Wang, Y Lu, B Yuan, B Chen… - International …, 2023‏ - proceedings.mlr.press
Distributed training of foundation models, especially large language models (LLMs), is
communication-intensive and so has heavily relied on centralized data centers with fast …