Infoot: Information maximizing optimal transport
Optimal transport aligns samples across distributions by minimizing the transportation cost
between them, eg, the geometric distances. Yet, it ignores coherence structure in the data …
between them, eg, the geometric distances. Yet, it ignores coherence structure in the data …
Sinkhorn distributionally robust optimization
We study distributionally robust optimization (DRO) with Sinkhorn distance--a variant of
Wasserstein distance based on entropic regularization. We derive convex programming …
Wasserstein distance based on entropic regularization. We derive convex programming …
A communication optimal transport approach to the computation of rate distortion functions
In this paper, we propose a new framework named Communication Optimal Transport
(CommOT) for computing the rate distortion (RD) function. This work is motivated by …
(CommOT) for computing the rate distortion (RD) function. This work is motivated by …
An algebraic and probabilistic framework for network information theory
In this monograph, we develop a mathematical framework based on asymptotically good
random structured codes, ie, codes possessing algebraic properties, for network information …
random structured codes, ie, codes possessing algebraic properties, for network information …
Lossy compression with distribution shift as entropy constrained optimal transport
We study an extension of lossy compression where the reconstruction distribution is different
from the source distribution in order to account for distributional shift due to processing. We …
from the source distribution in order to account for distributional shift due to processing. We …
Cross-domain lossy compression as entropy constrained optimal transport
We study an extension of lossy compression where the reconstruction is subject to a
distribution constraint which can be different from the source distribution. We formulate our …
distribution constraint which can be different from the source distribution. We formulate our …
Generalizations of talagrand inequality for sinkhorn distance using entropy power inequality
The distance that compares the difference between two probability distributions plays a
fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a …
fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a …
A strengthened cutset upper bound on the capacity of the relay channel and applications
We develop a new upper bound on the capacity of the relay channel that is tighter than
previously known upper bounds. This upper bound is proved using traditional weak …
previously known upper bounds. This upper bound is proved using traditional weak …
Rate-limited quantum-to-classical optimal transport: A lossy source coding perspective
We consider the rate-limited quantum-to-classical optimal transport in terms of output-
constrained rate-distortion coding for discrete quantum measurement systems with limited …
constrained rate-distortion coding for discrete quantum measurement systems with limited …
Information geometry for the working information theorist
Information geometry is a study of statistical manifolds, that is, spaces of probability
distributions from a geometric perspective. Its classical information-theoretic applications …
distributions from a geometric perspective. Its classical information-theoretic applications …