Advances and open problems in federated learning

P Kairouz, HB McMahan, B Avent… - … and trends® in …, 2021 - nowpublishers.com
Federated learning (FL) is a machine learning setting where many clients (eg, mobile
devices or whole organizations) collaboratively train a model under the orchestration of a …

Privacy amplification via compression: Achieving the optimal privacy-accuracy-communication trade-off in distributed mean estimation

WN Chen, D Song, A Ozgur… - Advances in Neural …, 2023 - proceedings.neurips.cc
Privacy and communication constraints are two major bottlenecks in federated learning (FL)
and analytics (FA). We study the optimal accuracy of mean and frequency estimation …

Breaking the communication-privacy-accuracy trilemma

WN Chen, P Kairouz, A Ozgur - Advances in Neural …, 2020 - proceedings.neurips.cc
Two major challenges in distributed learning and estimation are 1) preserving the privacy of
the local samples; and 2) communicating them efficiently to a central server, while achieving …

Personalized federated learning by structured and unstructured pruning under data heterogeneity

S Vahidian, M Morafah, B Lin - 2021 IEEE 41st international …, 2021 - ieeexplore.ieee.org
The traditional approach in FL tries to learn a single global model collaboratively with the
help of many clients under the orchestration of a central server. However, learning a single …

Information compression in the AI era: Recent advances and future challenges

J Chen, Y Fang, A Khisti, A Ozgur, N Shlezinger… - arxiv preprint arxiv …, 2024 - arxiv.org
This survey articles focuses on emerging connections between the fields of machine
learning and data compression. While fundamental limits of classical (lossy) data …

Model compression for communication efficient federated learning

SM Shah, VKN Lau - IEEE Transactions on Neural Networks …, 2021 - ieeexplore.ieee.org
Despite the many advantages of using deep neural networks over shallow networks in
various machine learning tasks, their effectiveness is compromised in a federated learning …

Communication-efficient federated learning with binary neural networks

Y Yang, Z Zhang, Q Yang - IEEE Journal on Selected Areas in …, 2021 - ieeexplore.ieee.org
Federated learning (FL) is a privacy-preserving machine learning setting that enables many
devices to jointly train a shared global model without the need to reveal their data to a …

Sam: An efficient approach with selective aggregation of models in federated learning

Y Shi, P Fan, Z Zhu, C Peng, F Wang… - IEEE Internet of Things …, 2024 - ieeexplore.ieee.org
Federated learning (FL) is a promising distributed learning mechanism that revolutionizes
our interaction with data in the IoT ecosystem. Due to the rapidly growing scale of smart …

Optimal compression of locally differentially private mechanisms

A Shah, WN Chen, J Balle… - International …, 2022 - proceedings.mlr.press
Compressing the output of $\epsilon $-locally differentially private (LDP) randomizers
naively leads to suboptimal utility. In this work, we demonstrate the benefits of using …

rTop-k: A Statistical Estimation Approach to Distributed SGD

LP Barnes, HA Inan, B Isik… - IEEE Journal on Selected …, 2020 - ieeexplore.ieee.org
The large communication cost for exchanging gradients between different nodes
significantly limits the scalability of distributed training for large-scale learning models …