A fundamental tradeoff between computation and communication in distributed computing

S Li, MA Maddah-Ali, Q Yu… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
How can we optimally trade extra computing power to reduce the communication load in
distributed computing? We answer this question by characterizing a fundamental tradeoff …

Coded computing: Mitigating fundamental bottlenecks in large-scale distributed computing and machine learning

S Li, S Avestimehr - Foundations and Trends® in …, 2020 - nowpublishers.com
We introduce the concept of “coded computing”, a novel computing paradigm that utilizes
coding theory to effectively inject and leverage data/computation redundancy to mitigate …

Over-the-air function computation in sensor networks

O Abari, H Rahul, D Katabi - arxiv preprint arxiv:1612.02307, 2016 - arxiv.org
Many sensor applications are interested in computing a function over measurements (eg,
sum, average, max) as opposed to collecting all sensor data. Today, such data aggregation …

Compression with exact error distribution for federated learning

M Hegazy, R Leluc, CT Li, A Dieuleveut - arxiv preprint arxiv:2310.20682, 2023 - arxiv.org
Compression schemes have been extensively used in Federated Learning (FL) to reduce
the communication cost of distributed learning. While most approaches rely on a bounded …

Network coding for computing: Cut-set bounds

R Appuswamy, M Franceschetti… - IEEE Transactions …, 2011 - ieeexplore.ieee.org
The following network computing problem is considered. Source nodes in a directed acyclic
network generate independent messages and a single receiver node computes a target …

The capacity of classical summation over a quantum MAC with arbitrarily distributed inputs and entanglements

Y Yao, SA Jafar - IEEE Transactions on Information Theory, 2024 - ieeexplore.ieee.org
The-QMAC problem is introduced, involving S servers, K classical () data streams, and T
independent quantum systems. Data stream is replicated at a subset of servers, and …

On network coding for sum-networks

BK Rai, BK Dey - IEEE Transactions on Information Theory, 2012 - ieeexplore.ieee.org
A directed acyclic network is considered where all the terminals need to recover the sum of
the symbols generated at all the sources. We call such a network a sum-network. It is shown …

On network functional compression

S Feizi, M Médard - IEEE transactions on information theory, 2014 - ieeexplore.ieee.org
In this paper, we consider different aspects of the problem of compressing for function
computation across a network, which we call network functional compression. In network …

Improved upper bound on the network function computing capacity

X Guang, RW Yeung, S Yang… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
The problem of network function computation over a directed acyclic network is investigated
in this paper. In such a network, a sink node desires to compute with zero error a target …

Computing linear functions by linear coding over networks

R Appuswamy, M Franceschetti - IEEE transactions on …, 2013 - ieeexplore.ieee.org
We consider the scenario in which a set of sources generates messages in a network and a
receiver node demands an arbitrary linear function of these messages. We formulate an …