Optimal complexity in decentralized training
Decentralization is a promising method of scaling up parallel machine learning systems. In
this paper, we provide a tight lower bound on the iteration complexity for such methods in a …
this paper, we provide a tight lower bound on the iteration complexity for such methods in a …
Achieving acceleration for distributed economic dispatch in smart grids over directed networks
In this paper, the economic dispatch problem (EDP) in smart grids is investigated over a
directed network, which concentrates on allocating the generation power among the …
directed network, which concentrates on allocating the generation power among the …
Decentralized stochastic gradient tracking for non-convex empirical risk minimization
This paper studies a decentralized stochastic gradient tracking (DSGT) algorithm for non-
convex empirical risk minimization problems over a peer-to-peer network of nodes, which is …
convex empirical risk minimization problems over a peer-to-peer network of nodes, which is …
Optimal gradient tracking for decentralized optimization
In this paper, we focus on solving the decentralized optimization problem of minimizing the
sum of n objective functions over a multi-agent network. The agents are embedded in an …
sum of n objective functions over a multi-agent network. The agents are embedded in an …
Robust online learning over networks
The recent deployment of multi-agent networks has enabled the distributed solution of
learning problems, where agents cooperate to train a global model without sharing their …
learning problems, where agents cooperate to train a global model without sharing their …
A Tutorial on Distributed Optimization for Cooperative Robotics: from Setups and Algorithms to Toolboxes and Research Directions
Several interesting problems in multi-robot systems can be cast in the framework of
distributed optimization. Examples include multi-robot task allocation, vehicle routing, target …
distributed optimization. Examples include multi-robot task allocation, vehicle routing, target …
Hierarchical federated learning with multi-timescale gradient correction
While traditional federated learning (FL) typically focuses on a star topology where clients
are directly connected to a central server, real-world distributed systems often exhibit …
are directly connected to a central server, real-world distributed systems often exhibit …
Distributed optimization based on gradient tracking revisited: Enhancing convergence rate via surrogation
We study distributed multiagent optimization over graphs. We consider the minimization of
F+G subject to convex constraints, where F is the smooth strongly convex sum of the agent's …
F+G subject to convex constraints, where F is the smooth strongly convex sum of the agent's …
Distributed delayed dual averaging for distributed optimization over time-varying digraphs
In this paper, a push-sum based distributed delayed dual averaging algorithm (PS-DDDA) is
proposed to solve the distributed constrained optimization problem over the time-varying …
proposed to solve the distributed constrained optimization problem over the time-varying …
Distributed Nesterov gradient and heavy-ball double accelerated asynchronous optimization
In this article, we come up with a novel Nesterov gradient and heavy-ball double accelerated
distributed synchronous optimization algorithm, called NHDA, and adopt a general …
distributed synchronous optimization algorithm, called NHDA, and adopt a general …