(Amplified) Banded Matrix Factorization: A unified approach to private training

CA Choquette-Choo, A Ganesh… - Advances in …, 2023 - proceedings.neurips.cc
Matrix factorization (MF) mechanisms for differential privacy (DP) have substantially
improved the state-of-the-art in privacy-utility-computation tradeoffs for ML applications in a …

Improved differential privacy for sgd via optimal private linear operators on adaptive streams

S Denisov, HB McMahan, J Rush… - Advances in …, 2022 - proceedings.neurips.cc
Motivated by recent applications requiring differential privacy in the setting of adaptive
streams, we investigate the question of optimal instantiations of the matrix mechanism in this …

Multi-epoch matrix factorization mechanisms for private machine learning

CA Choquette-Choo, HB McMahan, K Rush… - arxiv preprint arxiv …, 2022 - arxiv.org
We introduce new differentially private (DP) mechanisms for gradient-based machine
learning (ML) with multiple passes (epochs) over a dataset, substantially improving the …

Correlated noise provably beats independent noise for differentially private learning

CA Choquette-Choo, K Dvijotham, K Pillutla… - arxiv preprint arxiv …, 2023 - arxiv.org
Differentially private learning algorithms inject noise into the learning process. While the
most common private learning algorithm, DP-SGD, adds independent Gaussian noise in …

A smooth binary mechanism for efficient private continual observation

JD Andersson, R Pagh - Advances in Neural Information …, 2023 - proceedings.neurips.cc
In privacy under continual observation we study how to release differentially private
estimates based on a dataset that evolves over time. The problem of releasing private prefix …

Privacy amplification for matrix mechanisms

CA Choquette-Choo, A Ganesh, T Steinke… - arxiv preprint arxiv …, 2023 - arxiv.org
Privacy amplification exploits randomness in data selection to provide tighter differential
privacy (DP) guarantees. This analysis is key to DP-SGD's success in machine learning, but …

A unifying framework for differentially private sums under continual observation

M Henzinger, J Upadhyay, S Upadhyay - … of the 2024 Annual ACM-SIAM …, 2024 - SIAM
We study the problem of maintaining a differentially private decaying sum under continual
observation. We give a unifying framework and an efficient algorithm for this problem for any …

Improved differentially private continual observation using group algebra

M Henzinger, J Upadhyay - Proceedings of the 2025 Annual ACM-SIAM …, 2025 - SIAM
Differentially private weighted prefix sum under continual observation is a crucial component
in the production-level deployment of private next-word prediction for Gboard, which …

The discrepancy of shortest paths

G Bodwin, C Deng, J Gao, G Hoppenworth… - arxiv preprint arxiv …, 2024 - arxiv.org
The hereditary discrepancy of a set system is a certain quantitative measure of the
pseudorandom properties of the system. Roughly, hereditary discrepancy measures how …

Continual release of differentially private synthetic data from longitudinal data collections

M Bun, M Gaboardi, M Neunhoeffer… - Proceedings of the ACM …, 2024 - dl.acm.org
Motivated by privacy concerns in long-term longitudinal studies in medical and social
science research, we study the problem of continually releasing differentially private …