Robust and differentially private mean estimation

X Liu, W Kong, S Kakade, S Oh - Advances in neural …, 2021 - proceedings.neurips.cc
In statistical learning and analysis from shared data, which is increasingly widely adopted in
platforms such as federated learning and meta-learning, there are two major concerns …

Private and online learnability are equivalent

N Alon, M Bun, R Livni, M Malliaris… - ACM Journal of the ACM …, 2022 - dl.acm.org
Let H be a binary-labeled concept class. We prove that H can be PAC learned by an
(approximate) differentially private algorithm if and only if it has a finite Littlestone dimension …

Replicable learning of large-margin halfspaces

A Kalavasis, A Karbasi, KG Larsen, G Velegkas… - arxiv preprint arxiv …, 2024 - arxiv.org
We provide efficient replicable algorithms for the problem of learning large-margin
halfspaces. Our results improve upon the algorithms provided by Impagliazzo, Lei, Pitassi …

Sentence-level privacy for document embeddings

C Meehan, K Mrini, K Chaudhuri - arxiv preprint arxiv:2205.04605, 2022 - arxiv.org
User language data can contain highly sensitive personal content. As such, it is imperative
to offer users a strong and interpretable privacy guarantee when learning from their data. In …

Optimal differentially private learning of thresholds and quasi-concave optimization

E Cohen, X Lyu, J Nelson, T Sarlós… - Proceedings of the 55th …, 2023 - dl.acm.org
The problem of learning threshold functions is a fundamental one in machine learning.
Classical learning theory implies sample complexity of O (ξ− 1 log (1/β))(for generalization …

Easy differentially private linear regression

K Amin, M Joseph, M Ribero, S Vassilvitskii - arxiv preprint arxiv …, 2022 - arxiv.org
Linear regression is a fundamental tool for statistical analysis. This has motivated the
development of linear regression methods that also satisfy differential privacy and thus …

Sample-efficient proper PAC learning with approximate differential privacy

B Ghazi, N Golowich, R Kumar… - Proceedings of the 53rd …, 2021 - dl.acm.org
In this paper we prove that the sample complexity of properly learning a class of Littlestone
dimension d with approximate differential privacy is Õ (d 6), ignoring privacy and accuracy …

Stability is stable: Connections between replicability, privacy, and adaptive generalization

M Bun, M Gaboardi, M Hopkins, R Impagliazzo… - Proceedings of the 55th …, 2023 - dl.acm.org
The notion of replicable algorithms was introduced by Impagliazzo, Lei, Pitassi, and Sorrell
(STOC'22) to describe randomized algorithms that are stable under the resampling of their …

Closure properties for private classification and online prediction

N Alon, A Beimel, S Moran… - Conference on Learning …, 2020 - proceedings.mlr.press
Let H be a class of boolean functions and consider a composed class H'that is derived from
H using some arbitrary aggregation rule (for example, H'may be the class of all 3-wise …

Characterizing the sample complexity of pure private learners

A Beimel, K Nissim, U Stemmer - Journal of Machine Learning Research, 2019 - jmlr.org
Abstract Kasiviswanathan et al.(FOCS 2008) defined private learning as a combination of
PAC learning and differential privacy. Informally, a private learner is applied to a collection of …