Byzantine machine learning: A primer

R Guerraoui, N Gupta, R Pinot - ACM Computing Surveys, 2024 - dl.acm.org
The problem of Byzantine resilience in distributed machine learning, aka Byzantine machine
learning, consists of designing distributed algorithms that can train an accurate model …

Attack of the tails: Yes, you really can backdoor federated learning

H Wang, K Sreenivasan, S Rajput… - Advances in neural …, 2020 - proceedings.neurips.cc
Due to its decentralized nature, Federated Learning (FL) lends itself to adversarial attacks in
the form of backdoors during training. The goal of a backdoor is to corrupt the performance …

Byzantine-robust distributed learning: Towards optimal statistical rates

D Yin, Y Chen, R Kannan… - … conference on machine …, 2018 - proceedings.mlr.press
In this paper, we develop distributed optimization algorithms that are provably robust against
Byzantine failures—arbitrary and potentially adversarial behavior, in distributed computing …

Machine learning with adversaries: Byzantine tolerant gradient descent

P Blanchard, EM El Mhamdi… - Advances in neural …, 2017 - proceedings.neurips.cc
We study the resilience to Byzantine failures of distributed implementations of Stochastic
Gradient Descent (SGD). So far, distributed machine learning frameworks have largely …

Fast convergence rates for distributed non-Bayesian learning

A Nedić, A Olshevsky, CA Uribe - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
We consider the problem of distributed learning, where a network of agents collectively aim
to agree on a hypothesis that best explains a set of distributed observations of conditionally …

Defending against saddle point attack in Byzantine-robust distributed learning

D Yin, Y Chen, R Kannan… - … Conference on Machine …, 2019 - proceedings.mlr.press
We study robust distributed learning that involves minimizing a non-convex loss function
with saddle points. We consider the Byzantine setting where some worker machines have …

A tutorial on distributed (non-bayesian) learning: Problem, algorithms and results

A Nedić, A Olshevsky, CA Uribe - 2016 IEEE 55th Conference …, 2016 - ieeexplore.ieee.org
We overview some results on distributed learning with focus on a family of recently proposed
algorithms known as non-Bayesian social learning. We consider different approaches to the …

Multi-armed bandits in multi-agent networks

S Shahrampour, A Rakhlin… - 2017 IEEE International …, 2017 - ieeexplore.ieee.org
This paper addresses the multi-armed bandit problem in a multi-player framework. Players
explore a finite set of arms with stochastic rewards, and the reward distribution of each arm …

Fault-tolerance in distributed optimization: The case of redundancy

N Gupta, NH Vaidya - Proceedings of the 39th Symposium on Principles …, 2020 - dl.acm.org
This paper considers the problem of Byzantine fault-tolerance in distributed multi-agent
optimization. In this problem, each agent has a local cost function. The goal of a distributed …

Finite-time guarantees for Byzantine-resilient distributed state estimation with noisy measurements

L Su, S Shahrampour - IEEE Transactions on Automatic …, 2019 - ieeexplore.ieee.org
This article considers resilient cooperative state estimation in unreliable multiagent
networks. A network of agents aim to collaboratively estimate the value of an unknown …