Demystifying Fixed -Nearest Neighbor Information Estimators

W Gao, S Oh, P Viswanath - IEEE Transactions on Information …, 2018 - ieeexplore.ieee.org
Estimating mutual information from independent identically distributed samples drawn from
an unknown joint density function is a basic statistical problem of broad interest with …

The undecidability of conditional affine information inequalities and conditional independence implication with a binary constraint

CT Li - IEEE Transactions on Information Theory, 2022 - ieeexplore.ieee.org
We establish the undecidability of conditional affine information inequalities, the
undecidability of the conditional independence implication problem with a constraint that …

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

AV Makkuva, Y Wu - IEEE Transactions on Information Theory, 2018 - ieeexplore.ieee.org
This paper addresses the correspondence between linear inequalities for Shannon entropy
and differential entropy for sums of independent group-valued random variables. We show …

A joint typicality approach to compute–forward

SH Lim, C Feng, A Pastore, B Nazer… - IEEE Transactions on …, 2018 - ieeexplore.ieee.org
This paper presents a joint typicality framework for encoding and decoding nested linear
codes in multi-user networks. This framework provides a new perspective on compute …

A joint typicality approach to algebraic network information theory

SH Lim, C Feng, A Pastore, B Nazer… - arxiv preprint arxiv …, 2016 - arxiv.org
This paper presents a joint typicality framework for encoding and decoding nested linear
codes for multi-user networks. This framework provides a new perspective on compute …

Information theory meets big data: Theory, algorithms and applications to deep learning

W Gao - 2019 - ideals.illinois.edu
As the era of big data arises, people get access to numerous amounts of multi-view data.
Measuring, discovering and understanding the underlying relationship among different …

On equivalence of additive-combinatorial inequalities for Shannon entropy and differential entropy

AV Makkuva - 2017 - ideals.illinois.edu
Entropy inequalities are very important in information theory and they play a crucial role in
various communication-theoretic problems, for example, in the study of the degrees of …