A survey of distributed optimization

T Yang, X Yi, J Wu, Y Yuan, D Wu, Z Meng… - Annual Reviews in …, 2019 - Elsevier
In distributed optimization of multi-agent systems, agents cooperate to minimize a global
function which is a sum of local objective functions. Motivated by applications including …

Communication-efficient algorithms for decentralized and stochastic optimization

G Lan, S Lee, Y Zhou - Mathematical Programming, 2020 - Springer
We present a new class of decentralized first-order methods for nonsmooth and stochastic
optimization problems defined over multiagent networks. Considering that communication is …

Prox-PDA: The proximal primal-dual algorithm for fast distributed nonconvex optimization and learning over networks

M Hong, D Ha**ezhad… - … Conference on Machine …, 2017 - proceedings.mlr.press
In this paper we consider nonconvex optimization and learning over a network of distributed
nodes. We develop a Proximal Primal-Dual Algorithm (Prox-PDA), which enables the …

ZONE: Zeroth-order nonconvex multiagent optimization over networks

D Ha**ezhad, M Hong, A Garcia - IEEE transactions on …, 2019 - ieeexplore.ieee.org
In this paper, we consider distributed optimization problems over a multiagent network,
where each agent can only partially evaluate the objective function, and it is allowed to …

Distributed non-convex first-order optimization and information processing: Lower complexity bounds and rate optimal algorithms

H Sun, M Hong - IEEE Transactions on Signal processing, 2019 - ieeexplore.ieee.org
We consider a class of popular distributed non-convex optimization problems, in which
agents connected by a network ς collectively optimize a sum of smooth (possibly non …

Survey of distributed algorithms for resource allocation over multi-agent systems

M Doostmohammadian, A Aghasi, M Pirani… - Annual Reviews in …, 2025 - Elsevier
Resource allocation and scheduling in multi-agent systems present challenges due to
complex interactions and decentralization. This survey paper provides a comprehensive …

Perturbed proximal primal–dual algorithm for nonconvex nonsmooth optimization

D Ha**ezhad, M Hong - Mathematical Programming, 2019 - Springer
In this paper, we propose a perturbed proximal primal–dual algorithm (PProx-PDA) for an
important class of linearly constrained optimization problems, whose objective is the sum of …

Gradient primal-dual algorithm converges to second-order stationary solution for nonconvex distributed optimization over networks

M Hong, M Razaviyayn, J Lee - International Conference on …, 2018 - proceedings.mlr.press
In this work, we study two first-order primal-dual based algorithms, the Gradient Primal-Dual
Algorithm (GPDA) and the Gradient Alternating Direction Method of Multipliers (GADMM), for …

DISA: A dual inexact splitting algorithm for distributed convex composite optimization

L Guo, X Shi, S Yang, J Cao - IEEE Transactions on Automatic …, 2023 - ieeexplore.ieee.org
In this article, we propose a novel dual inexact splitting algorithm (DISA) for distributed
convex composite optimization problems, where the local loss function consists of a smooth …

Zeroth order nonconvex multi-agent optimization over networks

D Ha**ezhad, M Hong, A Garcia - arxiv preprint arxiv:1710.09997, 2017 - arxiv.org
In this paper, we consider distributed optimization problems over a multi-agent network,
where each agent can only partially evaluate the objective function, and it is allowed to …