Communication-efficient distributed learning: An overview

X Cao, T Başar, S Diggavi, YC Eldar… - IEEE journal on …, 2023 - ieeexplore.ieee.org
Distributed learning is envisioned as the bedrock of next-generation intelligent networks,
where intelligent agents, such as mobile devices, robots, and sensors, exchange information …

An exact quantized decentralized gradient descent algorithm

A Reisizadeh, A Mokhtari, H Hassani… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
We consider the problem of decentralized consensus optimization, where the sum of n
smooth and strongly convex functions are minimized over n distributed agents that form a …

Robust and communication-efficient collaborative learning

A Reisizadeh, H Taheri, A Mokhtari… - Advances in …, 2019 - proceedings.neurips.cc
We consider a decentralized learning problem, where a set of computing nodes aim at
solving a non-convex optimization problem collaboratively. It is well-known that …

On maintaining linear convergence of distributed learning and optimization under limited communication

S Magnússon, H Shokri-Ghadikolaei… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
In distributed optimization and machine learning, multiple nodes coordinate to solve large
problems. To do this, the nodes need to compress important algorithm information to bits so …

Fast convergence rates of distributed subgradient methods with adaptive quantization

TT Doan, ST Maguluri… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
We study distributed optimization problems over a network when the communication
between the nodes is constrained, and therefore, information that is exchanged between the …

Innovation compression for communication-efficient distributed optimization with linear convergence

J Zhang, K You, L **e - IEEE Transactions on Automatic …, 2023 - ieeexplore.ieee.org
Information compression is essential to reduce communication cost in distributed
optimization over peer-to-peer networks. This article proposes a communication-efficient …

Distributed optimization methods for multi-robot systems: Part 2—A survey

O Shorinwa, T Halsted, J Yu… - IEEE Robotics & …, 2024 - ieeexplore.ieee.org
Although the field of distributed optimization is well developed, relevant literature focused on
the application of distributed optimization to multi-robot problems is limited. This survey …

Quantized distributed gradient tracking algorithm with linear convergence in directed networks

Y **ong, L Wu, K You, L **e - IEEE Transactions on Automatic …, 2022 - ieeexplore.ieee.org
Communication efficiency is a major bottleneck in the applications of distributed networks.
To address the problem, the problem of quantized distributed optimization has attracted a lot …

Communication compression for distributed nonconvex optimization

X Yi, S Zhang, T Yang, T Chai… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
In this article, we consider distributed nonconvex optimization with the cost functions being
distributed over agents. Noting that information compression is a key tool to reduce the …

Finite-bit quantization for distributed algorithms with linear convergence

N Michelusi, G Scutari, CS Lee - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
This paper studies distributed algorithms for (strongly convex) composite optimization
problems over mesh networks, subject to quantized communications. Instead of focusing on …