Reasoning about generalization via conditional mutual information

T Steinke, L Zakynthinou - Conference on Learning Theory, 2020 - proceedings.mlr.press
We provide an information-theoretic framework for studying the generalization properties of
machine learning algorithms. Our framework ties together existing approaches, including …

Statistical indistinguishability of learning algorithms

A Kalavasis, A Karbasi, S Moran… - … on Machine Learning, 2023 - proceedings.mlr.press
When two different parties use the same learning rule on their own data, how can we test
whether the distributions of the two outcomes are similar? In this paper, we study the …

User-level differential privacy with few examples per user

B Ghazi, P Kamath, R Kumar… - Advances in …, 2023 - proceedings.neurips.cc
Previous work on user-level differential privacy (DP)[Ghazi et al. NeurIPS 2021, Bun et al.
STOC 2023] obtained generic algorithms that work for various learning tasks. However, their …

Private PAC learning implies finite Littlestone dimension

N Alon, R Livni, M Malliaris, S Moran - … of the 51st Annual ACM SIGACT …, 2019 - dl.acm.org
We show that every approximately differentially private learning algorithm (possibly
improper) for a class H with Littlestone dimension d requires Ω (log*(d)) examples. As a …

The role of interactivity in local differential privacy

M Joseph, J Mao, S Neel, A Roth - 2019 IEEE 60th Annual …, 2019 - ieeexplore.ieee.org
We study the power of interactivity in local differential privacy. First, we focus on the
difference between fully interactive and sequentially interactive protocols. Sequentially …

The bayesian stability zoo

S Moran, H Schefler, J Shafer - Advances in Neural …, 2023 - proceedings.neurips.cc
We show that many definitions of stability found in the learning theory literature are
equivalent to one another. We distinguish between two families of definitions of stability …

The structure of optimal private tests for simple hypotheses

CL Canonne, G Kamath, A McMillan, A Smith… - Proceedings of the 51st …, 2019 - dl.acm.org
Hypothesis testing plays a central role in statistical inference, and is used in many settings
where privacy concerns are paramount. This work answers a basic question about privately …

Max-information, differential privacy, and post-selection hypothesis testing

R Rogers, A Roth, A Smith… - 2016 IEEE 57th Annual …, 2016 - ieeexplore.ieee.org
In this paper, we initiate a principled study of how the generalization properties of
approximate differential privacy can be used to perform adaptive hypothesis testing, while …

On differential privacy and adaptive data analysis with bounded space

I Dinur, U Stemmer, DP Woodruff, S Zhou - … International Conference on …, 2023 - Springer
We study the space complexity of the two related fields of differential privacy and adaptive
data analysis. Specifically, Under standard cryptographic assumptions, we show that there …

Generalization in generative adversarial networks: A novel perspective from privacy protection

B Wu, S Zhao, C Chen, H Xu, L Wang… - Advances in …, 2019 - proceedings.neurips.cc
In this paper, we aim to understand the generalization properties of generative adversarial
networks (GANs) from a new perspective of privacy protection. Theoretically, we prove that a …