Distributed optimization in distribution systems: Use cases, limitations, and research needs

N Patari, V Venkataramanan… - … on Power Systems, 2021 - ieeexplore.ieee.org
Electric distribution grid operations typically rely on both centralized optimization and local
non-optimal control techniques. As an alternative, distribution system operational practices …

Fedpaq: A communication-efficient federated learning method with periodic averaging and quantization

A Reisizadeh, A Mokhtari, H Hassani… - International …, 2020 - proceedings.mlr.press
Federated learning is a distributed framework according to which a model is trained over a
set of devices, while kee** data localized. This framework faces several systems-oriented …

Distributed gradient methods for convex machine learning problems in networks: Distributed optimization

A Nedic - IEEE Signal Processing Magazine, 2020 - ieeexplore.ieee.org
This article provides an overview of distributed gradient methods for solving convex machine
learning problems of the form minxRn (1/m) ΣR i= 1 fi (x) in a system consisting of mm …

Exponential graph is provably efficient for decentralized deep training

B Ying, K Yuan, Y Chen, H Hu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Decentralized SGD is an emerging training method for deep learning known for its much
less (thus faster) communication per iteration, which relaxes the averaging step in parallel …

Distributed heavy-ball: A generalization and acceleration of first-order methods with gradient tracking

R **n, UA Khan - IEEE Transactions on Automatic Control, 2019 - ieeexplore.ieee.org
We study distributed optimization to minimize a sum of smooth and strongly-convex
functions. Recent work on this problem uses gradient tracking to achieve linear convergence …

A general framework for decentralized optimization with first-order methods

R **n, S Pu, A Nedić, UA Khan - Proceedings of the IEEE, 2020 - ieeexplore.ieee.org
Decentralized optimization to minimize a finite sum of functions, distributed over a network of
nodes, has been a significant area within control and signal-processing research due to its …

Massive digital over-the-air computation for communication-efficient federated edge learning

L Qiao, Z Gao, MB Mashhadi… - IEEE Journal on …, 2024 - ieeexplore.ieee.org
Over-the-air computation (AirComp) is a promising technology converging communication
and computation over wireless networks, which can be particularly effective in model …

Communication-censored ADMM for decentralized consensus optimization

Y Liu, W Xu, G Wu, Z Tian, Q Ling - IEEE Transactions on Signal …, 2019 - ieeexplore.ieee.org
In this paper, we devise a communication-efficient decentralized algorithm, named as
communication-censored alternating direction method of multipliers (ADMM)(COCA), to …

A survey of distributed optimization methods for multi-robot systems

T Halsted, O Shorinwa, J Yu, M Schwager - arxiv preprint arxiv …, 2021 - arxiv.org
Distributed optimization consists of multiple computation nodes working together to minimize
a common objective function through local computation iterations and network-constrained …

Parallel and distributed successive convex approximation methods for big-data optimization

A Nedić, JS Pang, G Scutari, Y Sun, G Scutari… - Multi-Agent Optimization …, 2018 - Springer
Recent years have witnessed a surge of interest in parallel and distributed optimization
methods for large-scale systems. In particular, nonconvex large-scale optimization problems …