Communication-efficient distributed learning: An overview

X Cao, T Başar, S Diggavi, YC Eldar… - IEEE journal on …, 2023 - ieeexplore.ieee.org
Distributed learning is envisioned as the bedrock of next-generation intelligent networks,
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …

Towards understanding biased client selection in federated learning

YJ Cho, J Wang, G Joshi - International Conference on …, 2022 - proceedings.mlr.press
Federated learning is a distributed optimization paradigm that enables a large number of
resource-limited client nodes to cooperatively train a model without data sharing. Previous …

A field guide to federated optimization

J Wang, Z Charles, Z Xu, G Joshi, HB McMahan… - arxiv preprint arxiv …, 2021 - arxiv.org
Federated learning and analytics are a distributed approach for collaboratively learning
models (or statistics) from decentralized data, motivated by and designed for privacy …

Federated learning with buffered asynchronous aggregation

J Nguyen, K Malik, H Zhan… - International …, 2022 - proceedings.mlr.press
Scalability and privacy are two critical concerns for cross-device federated learning (FL)
systems. In this work, we identify that synchronous FL–cannot scale efficiently beyond a few …

Proxskip: Yes! local gradient steps provably lead to communication acceleration! finally!

K Mishchenko, G Malinovsky, S Stich… - International …, 2022 - proceedings.mlr.press
We introduce ProxSkip—a surprisingly simple and provably efficient method for minimizing
the sum of a smooth ($ f $) and an expensive nonsmooth proximable ($\psi $) function. The …

Tackling the objective inconsistency problem in heterogeneous federated optimization

J Wang, Q Liu, H Liang, G Joshi… - Advances in neural …, 2020 - proceedings.neurips.cc
In federated learning, heterogeneity in the clients' local datasets and computation speeds
results in large variations in the number of local updates performed by each client in each …

Client selection in federated learning: Convergence analysis and power-of-choice selection strategies

YJ Cho, J Wang, G Joshi - arxiv preprint arxiv:2010.01243, 2020 - arxiv.org
Federated learning is a distributed optimization paradigm that enables a large number of
resource-limited client nodes to cooperatively train a model without data sharing. Several …

Advances and open problems in federated learning

P Kairouz, HB McMahan, B Avent… - … and trends® in …, 2021 - nowpublishers.com
Federated learning (FL) is a machine learning setting where many clients (eg, mobile
devices or whole organizations) collaboratively train a model under the orchestration of a …

Adaptive personalized federated learning

Y Deng, MM Kamani, M Mahdavi - arxiv preprint arxiv:2003.13461, 2020 - arxiv.org
Investigation of the degree of personalization in federated learning algorithms has shown
that only maximizing the performance of the global model will confine the capacity of the …

A unified theory of decentralized SGD with changing topology and local updates

A Koloskova, N Loizou, S Boreiri… - … on machine learning, 2020 - proceedings.mlr.press
Decentralized stochastic optimization methods have gained a lot of attention recently, mainly
because of their cheap per iteration cost, data locality, and their communication-efficiency. In …