Infoot: Information maximizing optimal transport

CY Chuang, S Jegelka… - … on Machine Learning, 2023 - proceedings.mlr.press
Optimal transport aligns samples across distributions by minimizing the transportation cost
between them, eg, the geometric distances. Yet, it ignores coherence structure in the data …

Sinkhorn distributionally robust optimization

J Wang, R Gao, Y **e - arxiv preprint arxiv:2109.11926, 2021 - arxiv.org
We study distributionally robust optimization (DRO) with Sinkhorn distance--a variant of
Wasserstein distance based on entropic regularization. We derive convex programming …

A communication optimal transport approach to the computation of rate distortion functions

S Wu, W Ye, H Wu, H Wu, W Zhang… - 2023 IEEE Information …, 2023 - ieeexplore.ieee.org
In this paper, we propose a new framework named Communication Optimal Transport
(CommOT) for computing the rate distortion (RD) function. This work is motivated by …

An algebraic and probabilistic framework for network information theory

SS Pradhan, A Padakandla… - Foundations and Trends …, 2020 - nowpublishers.com
In this monograph, we develop a mathematical framework based on asymptotically good
random structured codes, ie, codes possessing algebraic properties, for network information …

Lossy compression with distribution shift as entropy constrained optimal transport

H Liu, G Zhang, J Chen, AJ Khisti - International Conference on …, 2022 - openreview.net
We study an extension of lossy compression where the reconstruction distribution is different
from the source distribution in order to account for distributional shift due to processing. We …

Cross-domain lossy compression as entropy constrained optimal transport

H Liu, G Zhang, J Chen, A Khisti - IEEE Journal on Selected …, 2022 - ieeexplore.ieee.org
We study an extension of lossy compression where the reconstruction is subject to a
distribution constraint which can be different from the source distribution. We formulate our …

Generalizations of talagrand inequality for sinkhorn distance using entropy power inequality

S Wang, PA Stavrou, M Skoglund - Entropy, 2022 - mdpi.com
The distance that compares the difference between two probability distributions plays a
fundamental role in statistics and machine learning. Optimal transport (OT) theory provides a …

A strengthened cutset upper bound on the capacity of the relay channel and applications

A El Gamal, A Gohari, C Nair - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
We develop a new upper bound on the capacity of the relay channel that is tighter than
previously known upper bounds. This upper bound is proved using traditional weak …

Rate-limited quantum-to-classical optimal transport: A lossy source coding perspective

HM Garmaroudi, SS Pradhan… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
We consider the rate-limited quantum-to-classical optimal transport in terms of output-
constrained rate-distortion coding for discrete quantum measurement systems with limited …

Information geometry for the working information theorist

KV Mishra, MA Kumar, TKL Wong - arxiv preprint arxiv:2310.03884, 2023 - arxiv.org
Information geometry is a study of statistical manifolds, that is, spaces of probability
distributions from a geometric perspective. Its classical information-theoretic applications …