A survey of distributed optimization

T Yang, X Yi, J Wu, Y Yuan, D Wu, Z Meng… - Annual Reviews in …, 2019 - Elsevier
In distributed optimization of multi-agent systems, agents cooperate to minimize a global
function which is a sum of local objective functions. Motivated by applications including …

Distributed optimization for control

A Nedić, J Liu - Annual Review of Control, Robotics, and …, 2018 - annualreviews.org
Advances in wired and wireless technology have necessitated the development of theory,
models, and tools to cope with the new challenges posed by large-scale control and …

Achieving geometric convergence for distributed optimization over time-varying graphs

A Nedic, A Olshevsky, W Shi - SIAM Journal on Optimization, 2017 - SIAM
This paper considers the problem of distributed optimization over time-varying graphs. For
the case of undirected graphs, we introduce a distributed algorithm, referred to as DIGing …

Network topology and communication-computation tradeoffs in decentralized optimization

A Nedić, A Olshevsky, MG Rabbat - Proceedings of the IEEE, 2018 - ieeexplore.ieee.org
In decentralized optimization, nodes cooperate to minimize an overall objective function that
is the sum (or average) of per-node private objective functions. Algorithms interleave local …

Harnessing smoothness to accelerate distributed optimization

G Qu, N Li - IEEE Transactions on Control of Network Systems, 2017 - ieeexplore.ieee.org
There has been a growing effort in studying the distributed optimization problem over a
network. The objective is to optimize a global function formed by a sum of local functions …

Push–pull gradient methods for distributed optimization in networks

S Pu, W Shi, J Xu, A Nedić - IEEE Transactions on Automatic …, 2020 - ieeexplore.ieee.org
In this article, we focus on solving a distributed convex optimization problem in a network,
where each agent has its own convex cost function and the goal is to minimize the sum of …

Tutorial on dynamic average consensus: The problem, its applications, and the algorithms

SS Kia, B Van Scoy, J Cortes… - IEEE Control …, 2019 - ieeexplore.ieee.org
Technological advances in ad hoc networking and the availability of low-cost reliable
computing, data storage, and sensing devices have made scenarios possible where the …

A linear algorithm for optimization over directed graphs with geometric convergence

R **n, UA Khan - IEEE Control Systems Letters, 2018 - ieeexplore.ieee.org
In this letter, we study distributed optimization, where a network of agents, abstracted as a
directed graph, collaborates to minimize the average of locally known convex functions …

A decentralized proximal-gradient method with network independent step-sizes and separated convergence rates

Z Li, W Shi, M Yan - IEEE Transactions on Signal Processing, 2019 - ieeexplore.ieee.org
This paper proposes a novel proximal-gradient algorithm for a decentralized optimization
problem with a composite objective containing smooth and nonsmooth terms. Specifically …

Accelerated distributed Nesterov gradient descent

G Qu, N Li - IEEE Transactions on Automatic Control, 2019 - ieeexplore.ieee.org
This paper considers the distributed optimization problem over a network, where the
objective is to optimize a global function formed by a sum of local functions, using only local …