Communication-efficient distributed learning: An overview
Distributed learning is envisioned as the bedrock of next-generation intelligent networks,
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …
An exact quantized decentralized gradient descent algorithm
We consider the problem of decentralized consensus optimization, where the sum of n
smooth and strongly convex functions are minimized over n distributed agents that form a …
smooth and strongly convex functions are minimized over n distributed agents that form a …
Robust and communication-efficient collaborative learning
We consider a decentralized learning problem, where a set of computing nodes aim at
solving a non-convex optimization problem collaboratively. It is well-known that …
solving a non-convex optimization problem collaboratively. It is well-known that …
On maintaining linear convergence of distributed learning and optimization under limited communication
S Magnússon, H Shokri-Ghadikolaei… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
In distributed optimization and machine learning, multiple nodes coordinate to solve large
problems. To do this, the nodes need to compress important algorithm information to bits so …
problems. To do this, the nodes need to compress important algorithm information to bits so …
Fast convergence rates of distributed subgradient methods with adaptive quantization
TT Doan, ST Maguluri… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
We study distributed optimization problems over a network when the communication
between the nodes is constrained, and therefore, information that is exchanged between the …
between the nodes is constrained, and therefore, information that is exchanged between the …
Innovation compression for communication-efficient distributed optimization with linear convergence
Information compression is essential to reduce communication cost in distributed
optimization over peer-to-peer networks. This article proposes a communication-efficient …
optimization over peer-to-peer networks. This article proposes a communication-efficient …
Distributed optimization methods for multi-robot systems: Part 2—A survey
Although the field of distributed optimization is well developed, relevant literature focused on
the application of distributed optimization to multi-robot problems is limited. This survey …
the application of distributed optimization to multi-robot problems is limited. This survey …
Quantized distributed gradient tracking algorithm with linear convergence in directed networks
Communication efficiency is a major bottleneck in the applications of distributed networks.
To address the problem, the problem of quantized distributed optimization has attracted a lot …
To address the problem, the problem of quantized distributed optimization has attracted a lot …
Communication compression for distributed nonconvex optimization
In this article, we consider distributed nonconvex optimization with the cost functions being
distributed over agents. Noting that information compression is a key tool to reduce the …
distributed over agents. Noting that information compression is a key tool to reduce the …
Finite-bit quantization for distributed algorithms with linear convergence
This paper studies distributed algorithms for (strongly convex) composite optimization
problems over mesh networks, subject to quantized communications. Instead of focusing on …
problems over mesh networks, subject to quantized communications. Instead of focusing on …