Compression with bayesian implicit neural representations

Z Guo, G Flamich, J He, Z Chen… - Advances in …, 2024 - proceedings.neurips.cc
Many common types of data can be represented as functions that map coordinates to signal
values, such as pixel locations to RGB values in the case of an image. Based on this view …

Privacy amplification via compression: Achieving the optimal privacy-accuracy-communication trade-off in distributed mean estimation

WN Chen, D Song, A Ozgur… - Advances in Neural …, 2024 - proceedings.neurips.cc
Privacy and communication constraints are two major bottlenecks in federated learning (FL)
and analytics (FA). We study the optimal accuracy of mean and frequency estimation …

Faster relative entropy coding with greedy rejection coding

G Flamich, S Markou… - Advances in Neural …, 2024 - proceedings.neurips.cc
Relative entropy coding (REC) algorithms encode a sample from a target distribution $ Q $
using a proposal distribution $ P $ using as few bits as possible. Unlike entropy coding, REC …

Algorithms for the communication of samples

L Theis, NY Ahmed - International Conference on Machine …, 2022 - proceedings.mlr.press
The efficient communication of noisy data has applications in several areas of machine
learning, such as neural compression or differential privacy, and is also known as reverse …

Exact optimality of communication-privacy-utility tradeoffs in distributed mean estimation

B Isik, WN Chen, A Ozgur… - Advances in Neural …, 2024 - proceedings.neurips.cc
We study the mean estimation problem under communication and local differential privacy
constraints. While previous work has proposed order-optimal algorithms for the same …

Greedy Poisson rejection sampling

G Flamich - Advances in Neural Information Processing …, 2024 - proceedings.neurips.cc
One-shot channel simulation is a fundamental data compression problem concerned with
encoding a single sample from a target distribution $ Q $ using a coding distribution $ P …

Importance matching lemma for lossy compression with side information

B Phan, A Khisti, C Louizos - International Conference on …, 2024 - proceedings.mlr.press
We propose two extensions to existing importance sampling based methods for lossy
compression. First, we introduce an importance sampling based compression scheme that is …

Channel simulation: Theory and applications to lossy compression and differential privacy

CT Li - Foundations and Trends® in Communications and …, 2024 - nowpublishers.com
One-shot channel simulation (or channel synthesis) has seen increasing applications in
lossy compression, differential privacy and machine learning. In this setting, an encoder …

Compression with exact error distribution for federated learning

M Hegazy, R Leluc, CT Li, A Dieuleveut - arxiv preprint arxiv:2310.20682, 2023 - arxiv.org
Compression schemes have been extensively used in Federated Learning (FL) to reduce
the communication cost of distributed learning. While most approaches rely on a bounded …

Private frequency estimation via projective geometry

V Feldman, J Nelson, H Nguyen… - … on Machine Learning, 2022 - proceedings.mlr.press
In this work, we propose a new algorithm ProjectiveGeometryResponse (PGR) for locally
differentially private (LDP) frequency estimation. For universe size of k and with n users, our …