A survey on distributed machine learning

J Verbraeken, M Wolting, J Katzy… - Acm computing surveys …, 2020‏ - dl.acm.org
The demand for artificial intelligence has grown significantly over the past decade, and this
growth has been fueled by advances in machine learning techniques and the ability to …

From distributed machine learning to federated learning: A survey

J Liu, J Huang, Y Zhou, X Li, S Ji, H **ong… - … and Information Systems, 2022‏ - Springer
In recent years, data and computing resources are typically distributed in the devices of end
users, various regions or organizations. Because of laws or regulations, the distributed data …

Deep & cross network for ad click predictions

R Wang, B Fu, G Fu, M Wang - Proceedings of the ADKDD'17, 2017‏ - dl.acm.org
Feature engineering has been the key to the success of many prediction models. However,
the process is nontrivial and often requires manual feature engineering or exhaustive …

Scaling distributed machine learning with the parameter server

M Li, DG Andersen, JW Park, AJ Smola… - … USENIX Symposium on …, 2014‏ - usenix.org
We propose a parameter server framework for distributed machine learning problems. Both
data and workloads are distributed over worker nodes, while the server nodes maintain …

Communication efficient distributed machine learning with the parameter server

M Li, DG Andersen, AJ Smola… - Advances in Neural …, 2014‏ - proceedings.neurips.cc
This paper describes a third-generation parameter server framework for distributed machine
learning. This framework offers two relaxations to balance system performance and …

[PDF][PDF] A reliable effective terascale linear learning system

A Agarwal, O Chapelle, M Dudík, J Langford - The Journal of Machine …, 2014‏ - jmlr.org
We present a system and a set of techniques for learning linear predictors with convex
losses on terascale data sets, with trillions of features, 1 billions of training examples and …

A blockchain-based decentralized machine learning framework for collaborative intrusion detection within UAVs

AA Khan, MM Khan, KM Khan, J Arshad, F Ahmad - Computer Networks, 2021‏ - Elsevier
UAVs have numerous emerging applications in various domains of life. However, it is
extremely challenging to gain the required level of public acceptance of UAVs without …

[PDF][PDF] Scaling distributed machine learning with system and algorithm co-design

M Li - Santa Clara, CA, USA: Intel, 2017‏ - reports-archive.adm.cs.cmu.edu
Due to the rapid growth of data and the ever increasing model complexity, which often
manifests itself in the large number of model parameters, today, many important machine …

Performance modeling of distributed deep neural networks

SH Hashemi, SA Noghabi, W Gropp… - arxiv preprint arxiv …, 2016‏ - arxiv.org
During the past decade, machine learning has become extremely popular and can be found
in many aspects of our every day life. Nowayadays with explosion of data while rapid growth …

[PDF][PDF] Distributed delayed proximal gradient methods

M Li, DG Andersen, A Smola - NIPS Workshop on Optimization for …, 2013‏ - cs.cmu.edu
We analyze distributed optimization algorithms where parts of data and variables are
distributed over several machines and synchronization occurs asynchronously. We prove …