Federated learning: Challenges, methods, and future directions

T Li, AK Sahu, A Talwalkar… - IEEE signal processing …, 2020 - ieeexplore.ieee.org
Federated learning involves training statistical models over remote devices or siloed data
centers, such as mobile phones or hospitals, while kee** data localized. Training in …

Federated optimization in heterogeneous networks

T Li, AK Sahu, M Zaheer, M Sanjabi… - … of Machine learning …, 2020 - proceedings.mlsys.org
Federated Learning is a distributed learning paradigm with two key challenges that
differentiate it from traditional distributed optimization:(1) significant variability in terms of the …

Scaffold: Stochastic controlled averaging for federated learning

SP Karimireddy, S Kale, M Mohri… - International …, 2020 - proceedings.mlr.press
Federated learning is a key scenario in modern large-scale machine learning where the
data remains distributed over a large number of clients and the task is to learn a centralized …

On the convergence of fedavg on non-iid data

X Li, K Huang, W Yang, S Wang, Z Zhang - arxiv preprint arxiv …, 2019 - arxiv.org
Federated learning enables a large amount of edge computing devices to jointly learn a
model without data sharing. As a leading algorithm in this setting, Federated Averaging …

Communication efficiency in federated learning: Achievements and challenges

O Shahid, S Pouriyeh, RM Parizi, QZ Sheng… - arxiv preprint arxiv …, 2021 - arxiv.org
Federated Learning (FL) is known to perform Machine Learning tasks in a distributed
manner. Over the years, this has become an emerging technology especially with various …

Decentralised learning in federated deployment environments: A system-level survey

P Bellavista, L Foschini, A Mora - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
Decentralised learning is attracting more and more interest because it embodies the
principles of data minimisation and focused data collection, while favouring the transparency …

Federated optimization: Distributed machine learning for on-device intelligence

J Konečný, HB McMahan, D Ramage… - arxiv preprint arxiv …, 2016 - arxiv.org
We introduce a new and increasingly relevant setting for distributed optimization in machine
learning, where the data defining the optimization are unevenly distributed over an …

Byzantine-robust distributed learning: Towards optimal statistical rates

D Yin, Y Chen, R Kannan… - … conference on machine …, 2018 - proceedings.mlr.press
In this paper, we develop distributed optimization algorithms that are provably robust against
Byzantine failures—arbitrary and potentially adversarial behavior, in distributed computing …

Federated learning of a mixture of global and local models

F Hanzely, P Richtárik - arxiv preprint arxiv:2002.05516, 2020 - arxiv.org
We propose a new optimization formulation for training federated learning models. The
standard formulation has the form of an empirical risk minimization problem constructed to …

Communication-efficient federated deep learning with layerwise asynchronous model update and temporally weighted aggregation

Y Chen, X Sun, Y ** - IEEE transactions on neural networks …, 2019 - ieeexplore.ieee.org
Federated learning obtains a central model on the server by aggregating models trained
locally on clients. As a result, federated learning does not require clients to upload their data …