A survey of distributed optimization

T Yang, X Yi, J Wu, Y Yuan, D Wu, Z Meng… - Annual Reviews in …, 2019 - Elsevier
In distributed optimization of multi-agent systems, agents cooperate to minimize a global
function which is a sum of local objective functions. Motivated by applications including …

Distributed optimization for control

A Nedić, J Liu - Annual Review of Control, Robotics, and …, 2018 - annualreviews.org
Advances in wired and wireless technology have necessitated the development of theory,
models, and tools to cope with the new challenges posed by large-scale control and …

Network topology and communication-computation tradeoffs in decentralized optimization

A Nedić, A Olshevsky, MG Rabbat - Proceedings of the IEEE, 2018 - ieeexplore.ieee.org
In decentralized optimization, nodes cooperate to minimize an overall objective function that
is the sum (or average) of per-node private objective functions. Algorithms interleave local …

Next: In-network nonconvex optimization

P Di Lorenzo, G Scutari - IEEE Transactions on Signal and …, 2016 - ieeexplore.ieee.org
We study nonconvex distributed optimization in multiagent networks with time-varying
(nonsymmetric) connectivity. We introduce the first algorithmic framework for the distributed …

Distributed continuous-time optimization: nonuniform gradient gains, finite-time convergence, and convex constraint set

P Lin, W Ren, JA Farrell - IEEE Transactions on Automatic …, 2016 - ieeexplore.ieee.org
In this paper, a distributed optimization problem with general differentiable convex objective
functions is studied for continuous-time multi-agent systems with single-integrator dynamics …

Distributed nonconvex constrained optimization over time-varying digraphs

G Scutari, Y Sun - Mathematical Programming, 2019 - Springer
This paper considers nonconvex distributed constrained optimization over networks,
modeled as directed (possibly time-varying) graphs. We introduce the first algorithmic …

Distributed optimization for linear multiagent systems: Edge-and node-based adaptive designs

Y Zhao, Y Liu, G Wen, G Chen - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
This paper studies the distributed optimization problem for continuous-time multiagent
systems with general linear dynamics. The objective is to cooperatively optimize a team …

Distributed multi-agent optimization subject to nonidentical constraints and communication delays

P Lin, W Ren, Y Song - Automatica, 2016 - Elsevier
In this paper, we study a distributed optimization problem using a subgradient projection
algorithm for multi-agent systems subject to nonidentical constraints and communication …

On nonconvex decentralized gradient descent

J Zeng, W Yin - IEEE Transactions on signal processing, 2018 - ieeexplore.ieee.org
Consensus optimization has received considerable attention in recent years. A number of
decentralized algorithms have been proposed for convex consensus optimization. However …

Prox-PDA: The proximal primal-dual algorithm for fast distributed nonconvex optimization and learning over networks

M Hong, D Ha**ezhad… - … Conference on Machine …, 2017 - proceedings.mlr.press
In this paper we consider nonconvex optimization and learning over a network of distributed
nodes. We develop a Proximal Primal-Dual Algorithm (Prox-PDA), which enables the …