Byzantine machine learning: A primer

R Guerraoui, N Gupta, R Pinot - ACM Computing Surveys, 2024 - dl.acm.org
The problem of Byzantine resilience in distributed machine learning, aka Byzantine machine
learning, consists of designing distributed algorithms that can train an accurate model …

Adversary-resilient distributed and decentralized statistical inference and machine learning: An overview of recent advances under the Byzantine threat model

Z Yang, A Gang, WU Bajwa - IEEE Signal Processing …, 2020 - ieeexplore.ieee.org
Statistical inference and machine-learning algorithms have traditionally been developed for
data available at a single location. Unlike this centralized setting, modern data sets are …

Federated variance-reduced stochastic gradient descent with robustness to byzantine attacks

Z Wu, Q Ling, T Chen… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper deals with distributed finite-sum optimization for learning over multiple workers in
the presence of malicious Byzantine attacks. Most resilient approaches so far combine …

BRIDGE: Byzantine-resilient decentralized gradient descent

C Fang, Z Yang, WU Bajwa - IEEE Transactions on Signal and …, 2022 - ieeexplore.ieee.org
Machine learning has begun to play a central role in many applications. A multitude of these
applications typically also involve datasets that are distributed across multiple computing …

Variance reduction is an antidote to byzantines: Better rates, weaker assumptions and communication compression as a cherry on the top

E Gorbunov, S Horváth, P Richtárik, G Gidel - arxiv preprint arxiv …, 2022 - arxiv.org
Byzantine-robustness has been gaining a lot of attention due to the growth of the interest in
collaborative and federated learning. However, many fruitful directions, such as the usage of …

Byzantine-resilient decentralized stochastic optimization with robust aggregation rules

Z Wu, T Chen, Q Ling - IEEE transactions on signal processing, 2023 - ieeexplore.ieee.org
This article focuses on decentralized stochastic optimization in the presence of Byzantine
attacks. During the optimization process, an unknown number of malfunctioning or malicious …

Collaborative learning in the jungle (decentralized, byzantine, heterogeneous, asynchronous and nonconvex learning)

EM El-Mhamdi, S Farhadkhani… - Advances in neural …, 2021 - proceedings.neurips.cc
We study\emph {Byzantine collaborative learning}, where $ n $ nodes seek to collectively
learn from each others' local data. The data distribution may vary from one node to another …

Trustiness-based hierarchical decentralized federated learning

Y Li, X Wang, R Sun, X **e, S Ying, S Ren - Knowledge-Based Systems, 2023 - Elsevier
Federated Learning (FL) breaks the “data island” and lets clients cooperate in training a
shared model with private data locally. And hierarchical framework is used in FL to alleviate …

Robust training in high dimensions via block coordinate geometric median descent

A Acharya, A Hashemi, P Jain… - International …, 2022 - proceedings.mlr.press
Geometric median (GM) is a classical method in statistics for achieving robust estimation of
the uncorrupted data; under gross corruption, it achieves the optimal breakdown point of 1/2 …

Robust collaborative learning with linear gradient overhead

S Farhadkhani, R Guerraoui, N Gupta… - International …, 2023 - proceedings.mlr.press
Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty
machines that may deviate from their prescribed algorithm because of software or hardware …