Fine-tuning large language models with user-level differential privacy

Z Charles, A Ganesh, R McKenna… - arxiv preprint arxiv …, 2024 - arxiv.org
We investigate practical and scalable algorithms for training large language models (LLMs)
with user-level differential privacy (DP) in order to provably safeguard all the examples …

Federated linear contextual bandits with user-level differential privacy

R Huang, H Zhang, L Melis, M Shen… - International …, 2023 - proceedings.mlr.press
This paper studies federated linear contextual bandits under the notion of user-level
differential privacy (DP). We first introduce a unified federated bandits framework that can …

User-level private stochastic convex optimization with optimal rates

R Bassily, Z Sun - International Conference on Machine …, 2023 - proceedings.mlr.press
We study the problem of differentially private (DP) stochastic convex optimization (SCO)
under the notion of user-level differential privacy. In this problem, there are $ n $ users, each …

Private mean estimation with person-level differential privacy

S Agarwal, G Kamath, M Majid, A Mouzakis… - Proceedings of the 2025 …, 2025 - SIAM
We study person-level differentially private (DP) mean estimation in the case where each
person holds multiple samples. DP here requires the usual notion of distributional stability …

A statistical framework for personalized federated learning and estimation: Theory, algorithms, and privacy

K Ozkara, AM Girgis, D Data, SN Diggavi - International Conference on …, 2023 - par.nsf.gov
ABSTRACT A distinguishing characteristic of federated learning is that the (local) client data
could have statistical heterogeneity. This heterogeneity has motivated the design of …

Rate optimality and phase transition for user-level local differential privacy

A Kent, TB Berrett, Y Yu - arxiv preprint arxiv:2405.11923, 2024 - arxiv.org
Most of the literature on differential privacy considers the item-level case where each user
has a single observation, but a growing field of interest is that of user-level privacy where …

Exactly Minimax-Optimal Locally Differentially Private Sampling

HY Park, S Asoodeh, SH Lee - Advances in Neural …, 2025 - proceedings.neurips.cc
The sampling problem under local differential privacy has recently been studied with
potential applications to generative models, but a fundamental analysis of its privacy-utility …

Better locally private sparse estimation given multiple samples per user

Y Ma, K Jia, H Yang - arxiv preprint arxiv:2408.04313, 2024 - arxiv.org
Previous studies yielded discouraging results for item-level locally differentially private linear
regression with $ s^* $-sparsity assumption, where the minimax rate for $ nm $ samples is …

[Књига][B] Communication-Efficient and Private Distributed Learning

AMG Bebawy - 2023 - search.proquest.com
We are currently facing a rapid growth of data contents originating from edge devices. These
data resources offer significant potential for learning and extracting complex patterns in a …

A Survey on Local Differential Privacy

SUN Yifan, Z Rui, TAO Yang, GAO Birou… - Frontiers of Data and …, 2023 - jfdc.cnic.cn
[Objective] This paper systematically introduces local differential privacy and provides a
reference for the protection of personal data privacy under data sharing and …