Distributed adaptive learning under communication constraints

M Carpentiero, V Matta… - IEEE Open Journal of …, 2023 - ieeexplore.ieee.org
We consider a network of agents that must solve an online optimization problem from
continual observation of streaming data. To this end, the agents implement a distributed …

Metric mean dimension and analog compression

Y Gutman, A Śpiewak - IEEE Transactions on Information …, 2020 - ieeexplore.ieee.org
Wu and Verdú developed a theory of almost lossless analog compression, where one
imposes various regularity conditions on the compressor and the decompressor with the …

A probabilistic Takens theorem

K Barański, Y Gutman, A Śpiewak - Nonlinearity, 2020 - iopscience.iop.org
Abstract Let X⊂ RN be a Borel set, μ a Borel probability measure on X and T: X→ X a locally
Lipschitz and injective map. Fix k∈ N strictly greater than the (Hausdorff) dimension of X and …

Compressed Regression over Adaptive Networks

M Carpentiero, V Matta… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
In this work we derive the performance achievable by a network of distributed agents that
solve, adaptively and in the presence of communication constraints, a regression problem …

Almost lossless analog signal separation and probabilistic uncertainty relations

D Stotz, E Riegler, E Agustsson… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
We propose an information-theoretic framework for analog signal separation. Specifically,
we consider the problem of recovering two analog signals, modeled as general random …

Regularity of almost-surely injective projections in Euclidean spaces

K Barański, Y Gutman, A Śpiewak - arxiv preprint arxiv:2301.11918, 2023 - arxiv.org
In a previous work we proved that if a finite Borel measure $\mu $ in a Euclidean space has
Hausdorff dimension smaller than a positive integer $ k $, then the orthogonal projection …

Completion of matrices with low description complexity

E Riegler, G Koliander, D Stotz, H Bölcskei - arxiv preprint arxiv …, 2023 - arxiv.org
We propose a theory for matrix completion that goes beyond the low-rank structure
commonly considered in the literature and applies to general matrices of low description …

ARMA Processes with Discrete-Continuous Excitation: Compressibility Beyond Sparsity

MA Charusaie, S Rini, A Amini - arxiv preprint arxiv:2406.06349, 2024 - arxiv.org
R\'enyi Information Dimension (RID) plays a central role in quantifying the compressibility of
random variables with singularities in their distribution, encompassing and extending …

Lossless analog compression via polarization

S Yuan, L Yao, Y Li, H Zhang, J Wang… - … 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
In this paper, we study the lossless analog compression for iid nonsingular signals. Through
analyzing analog polarization under Hadamard transform, we propose efficient successive …

Lossy compression of general random variables

E Riegler, G Koliander, H Bölcskei - Information and Inference: A …, 2023 - academic.oup.com
This paper is concerned with the lossy compression of general random variables,
specifically with rate-distortion theory and quantization of random variables taking values in …