Byzantine machine learning: A primer
The problem of Byzantine resilience in distributed machine learning, aka Byzantine machine
learning, consists of designing distributed algorithms that can train an accurate model …
learning, consists of designing distributed algorithms that can train an accurate model …
Adversary-resilient distributed and decentralized statistical inference and machine learning: An overview of recent advances under the Byzantine threat model
Statistical inference and machine-learning algorithms have traditionally been developed for
data available at a single location. Unlike this centralized setting, modern data sets are …
data available at a single location. Unlike this centralized setting, modern data sets are …
Federated variance-reduced stochastic gradient descent with robustness to byzantine attacks
This paper deals with distributed finite-sum optimization for learning over multiple workers in
the presence of malicious Byzantine attacks. Most resilient approaches so far combine …
the presence of malicious Byzantine attacks. Most resilient approaches so far combine …
BRIDGE: Byzantine-resilient decentralized gradient descent
Machine learning has begun to play a central role in many applications. A multitude of these
applications typically also involve datasets that are distributed across multiple computing …
applications typically also involve datasets that are distributed across multiple computing …
Variance reduction is an antidote to byzantines: Better rates, weaker assumptions and communication compression as a cherry on the top
Byzantine-robustness has been gaining a lot of attention due to the growth of the interest in
collaborative and federated learning. However, many fruitful directions, such as the usage of …
collaborative and federated learning. However, many fruitful directions, such as the usage of …
Byzantine-resilient decentralized stochastic optimization with robust aggregation rules
This article focuses on decentralized stochastic optimization in the presence of Byzantine
attacks. During the optimization process, an unknown number of malfunctioning or malicious …
attacks. During the optimization process, an unknown number of malfunctioning or malicious …
Collaborative learning in the jungle (decentralized, byzantine, heterogeneous, asynchronous and nonconvex learning)
We study\emph {Byzantine collaborative learning}, where $ n $ nodes seek to collectively
learn from each others' local data. The data distribution may vary from one node to another …
learn from each others' local data. The data distribution may vary from one node to another …
Trustiness-based hierarchical decentralized federated learning
Y Li, X Wang, R Sun, X **e, S Ying, S Ren - Knowledge-Based Systems, 2023 - Elsevier
Federated Learning (FL) breaks the “data island” and lets clients cooperate in training a
shared model with private data locally. And hierarchical framework is used in FL to alleviate …
shared model with private data locally. And hierarchical framework is used in FL to alleviate …
Robust training in high dimensions via block coordinate geometric median descent
Geometric median (GM) is a classical method in statistics for achieving robust estimation of
the uncorrupted data; under gross corruption, it achieves the optimal breakdown point of 1/2 …
the uncorrupted data; under gross corruption, it achieves the optimal breakdown point of 1/2 …
Robust collaborative learning with linear gradient overhead
Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty
machines that may deviate from their prescribed algorithm because of software or hardware …
machines that may deviate from their prescribed algorithm because of software or hardware …