A survey on distributed machine learning
The demand for artificial intelligence has grown significantly over the past decade, and this
growth has been fueled by advances in machine learning techniques and the ability to …
growth has been fueled by advances in machine learning techniques and the ability to …
Federated optimization in heterogeneous networks
Federated Learning is a distributed learning paradigm with two key challenges that
differentiate it from traditional distributed optimization:(1) significant variability in terms of the …
differentiate it from traditional distributed optimization:(1) significant variability in terms of the …
On the convergence of fedavg on non-iid data
Federated learning enables a large amount of edge computing devices to jointly learn a
model without data sharing. As a leading algorithm in this setting, Federated Averaging …
model without data sharing. As a leading algorithm in this setting, Federated Averaging …
Federated optimization: Distributed machine learning for on-device intelligence
We introduce a new and increasingly relevant setting for distributed optimization in machine
learning, where the data defining the optimization are unevenly distributed over an …
learning, where the data defining the optimization are unevenly distributed over an …
Federated optimization: Distributed optimization beyond the datacenter
We introduce a new and increasingly relevant setting for distributed optimization in machine
learning, where the data defining the optimization are distributed (unevenly) over an …
learning, where the data defining the optimization are distributed (unevenly) over an …
Scaling distributed machine learning with {In-Network} aggregation
Training machine learning models in parallel is an increasingly important workload. We
accelerate distributed parallel training by designing a communication primitive that uses a …
accelerate distributed parallel training by designing a communication primitive that uses a …
Fast-convergent federated learning
Federated learning has emerged recently as a promising solution for distributing machine
learning tasks through modern networks of mobile devices. Recent studies have obtained …
learning tasks through modern networks of mobile devices. Recent studies have obtained …
Gaia:{Geo-Distributed} machine learning approaching {LAN} speeds
Machine learning (ML) is widely used to derive useful information from large-scale data
(such as user activities, pictures, and videos) generated at increasingly rapid rates, all over …
(such as user activities, pictures, and videos) generated at increasingly rapid rates, all over …