How to dp-fy ml: A practical guide to machine learning with differential privacy

N Ponomareva, H Hazimeh, A Kurakin, Z Xu… - Journal of Artificial …, 2023 - jair.org
Abstract Machine Learning (ML) models are ubiquitous in real-world applications and are a
constant focus of research. Modern ML models have become more complex, deeper, and …

Differentially private fine-tuning of language models

D Yu, S Naik, A Backurs, S Gopi, HA Inan… - arxiv preprint arxiv …, 2021 - arxiv.org
We give simpler, sparser, and faster algorithms for differentially private fine-tuning of large-
scale pre-trained language models, which achieve the state-of-the-art privacy versus utility …

The discrete gaussian for differential privacy

CL Canonne, G Kamath… - Advances in Neural …, 2020 - proceedings.neurips.cc
A key tool for building differentially private systems is adding Gaussian noise to the output of
a function evaluated on a sensitive dataset. Unfortunately, using a continuous distribution …

Numerical composition of differential privacy

S Gopi, YT Lee, L Wutschitz - Advances in Neural …, 2021 - proceedings.neurips.cc
We give a fast algorithm to compose privacy guarantees of differentially private (DP)
algorithms to arbitrary accuracy. Our method is based on the notion of privacy loss random …

Adversary instantiation: Lower bounds for differentially private machine learning

M Nasr, S Songi, A Thakurta… - … IEEE Symposium on …, 2021 - ieeexplore.ieee.org
Differentially private (DP) machine learning allows us to train models on private data while
limiting data leakage. DP formalizes this data leakage through a cryptographic game, where …

Optimal accounting of differential privacy via characteristic function

Y Zhu, J Dong, YX Wang - International Conference on …, 2022 - proceedings.mlr.press
Characterizing the privacy degradation over compositions, ie, privacy accounting, is a
fundamental topic in differential privacy (DP) with many applications to differentially private …

[PDF][PDF] Explore the relationship between security mechanisms and trust in e-banking: A systematic review

JA Al-Gasawneh - Annals of RSCB, 2021 - researchgate.net
Internet banking security is one of the main critical issues among online users over the
world. High level of threats, lack of trust, and fear of loss are the main barriers to utilize …

Composition of differential privacy & privacy amplification by subsampling

T Steinke - arxiv preprint arxiv:2210.00597, 2022 - arxiv.org
This chapter is meant to be part of the book" Differential Privacy for Artificial Intelligence
Applications." We give an introduction to the most important property of differential privacy …

Fine-tuning large language models with user-level differential privacy

Z Charles, A Ganesh, R McKenna… - arxiv preprint arxiv …, 2024 - arxiv.org
We investigate practical and scalable algorithms for training large language models (LLMs)
with user-level differential privacy (DP) in order to provably safeguard all the examples …

Improved differential privacy for sgd via optimal private linear operators on adaptive streams

S Denisov, HB McMahan, J Rush… - Advances in …, 2022 - proceedings.neurips.cc
Motivated by recent applications requiring differential privacy in the setting of adaptive
streams, we investigate the question of optimal instantiations of the matrix mechanism in this …