A new evidential reasoning rule with continuous probability distribution of reliability

J Wang, ZJ Zhou, CH Hu, SW Tang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Evidential reasoning (ER) rule has been widely used in dealing with uncertainty. As an
important parameter to measure the inherent property of evidence, the evidence reliability …

Shannon Bounds for Quadratic Rate-Distortion Problems

M Gastpar, E Sula - IEEE Journal on Selected Areas in …, 2024 - ieeexplore.ieee.org
The Shannon lower bound has been the subject of several important contributions by
Berger. This paper surveys Shannon bounds on rate-distortion problems under mean …

The checkerboard copula and dependence concepts

L Lin, R Wang, R Zhang, C Zhao - arxiv preprint arxiv:2404.15023, 2024 - arxiv.org
We study the problem of choosing the copula when the marginal distributions of a random
vector are not all continuous. Inspired by four motivating examples including simulation from …

Lossless analog compression

G Alberti, H Bölcskei, C De Lellis… - IEEE Transactions …, 2019 - ieeexplore.ieee.org
We establish the fundamental limits of lossless analog compression by considering the
recovery of arbitrary random vectors x∈ R m from the noiseless linear measurements y= Ax …

Minimal achievable sufficient statistic learning

M Cvitkovic, G Koliander - International Conference on …, 2019 - proceedings.mlr.press
Abstract We introduce Minimal Achievable Sufficient Statistic (MASS) Learning, a machine
learning training objective for which the minima are minimal sufficient statistics with respect …

Do neural networks compress manifolds optimally?

S Bhadane, AB Wagner, J Ballé - 2022 IEEE Information …, 2022 - ieeexplore.ieee.org
Artifical Neural-Network-based (ANN-based) lossy compressors have recently obtained
striking results on several sources. Their success may be ascribed to an ability to identify the …

Entropy under disintegrations

JP Vigneaux - International Conference on Geometric Science of …, 2021 - Springer
We consider the differential entropy of probability measures absolutely continuous with
respect to a given σ σ-finite “reference” measure on an arbitrary measure space. We state …

f-divergences and their applications in lossy compression and bounding generalization error

S Masiha, A Gohari, MH Yassaee - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In this paper, we provide three applications for-divergences:(i) we introduce Sanov's upper
bound on the tail probability of the sum of independent random variables based on super …

Lossy compression of general random variables

E Riegler, G Koliander, H Bölcskei - Information and Inference: A …, 2023 - academic.oup.com
This paper is concerned with the lossy compression of general random variables,
specifically with rate-distortion theory and quantization of random variables taking values in …

Rate-distortion theory for general sets and measures

E Riegler, H Bölcskei… - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
This paper is concerned with a rate-distortion theory for sequences of iid random variables
with general distribution supported on general sets including manifolds and fractal sets …