Manifold learning: What, how, and why

M Meilă, H Zhang - Annual Review of Statistics and Its …, 2024 - annualreviews.org
Manifold learning (ML), also known as nonlinear dimension reduction, is a set of methods to
find the low-dimensional structure of data. Dimension reduction for large, high-dimensional …

Nonparametric regression using deep neural networks with ReLU activation function

J Schmidt-Hieber - 2020 - projecteuclid.org
Nonparametric regression using deep neural networks with ReLU activation function Page 1
The Annals of Statistics 2020, Vol. 48, No. 4, 1875–1897 https://doi.org/10.1214/19-AOS1875 …

[BOOK][B] Weak convergence

AW Van Der Vaart, JA Wellner, AW van der Vaart… - 1996 - Springer
Weak Convergence Page 1 1.3 Weak Convergence In this section IDl and IE are metric spaces
with metrics d and e, respectively. The set of all continuous, bounded functions f: IDl 1--+ IR is …

Concentration inequalities

S Boucheron, G Lugosi, O Bousquet - Summer school on machine learning, 2003 - Springer
Concentration inequalities deal with deviations of functions of independent random
variables from their expectation. In the last decade new tools have been introduced making …

Policy learning with observational data

S Athey, S Wager - Econometrica, 2021 - Wiley Online Library
In many areas, practitioners seek to use observational data to learn a treatment assignment
policy that satisfies application‐specific constraints, such as budget, fairness, simplicity, or …

Efficient policy learning

S Athey, S Wager - 2017 - ideas.repec.org
There has been considerable interest across several fields in methods that reduce the
problem of learning good treatment assignment policies to the problem of accurate policy …

Orthogonal statistical learning

DJ Foster, V Syrgkanis - The Annals of Statistics, 2023 - projecteuclid.org
Orthogonal statistical learning Page 1 The Annals of Statistics 2023, Vol. 51, No. 3, 879–908
https://doi.org/10.1214/23-AOS2258 © Institute of Mathematical Statistics, 2023 ORTHOGONAL …

[BOOK][B] Oracle inequalities in empirical risk minimization and sparse recovery problems: École D'Été de Probabilités de Saint-Flour XXXVIII-2008

V Koltchinskii - 2011 - books.google.com
The purpose of these lecture notes is to provide an introduction to the general theory of
empirical risk minimization with an emphasis on excess risk bounds and oracle inequalities …

Feature learning via mean-field langevin dynamics: classifying sparse parities and beyond

T Suzuki, D Wu, K Oko… - Advances in Neural …, 2024 - proceedings.neurips.cc
Neural network in the mean-field regime is known to be capable of\textit {feature learning},
unlike the kernel (NTK) counterpart. Recent works have shown that mean-field neural …

Offline multi-action policy learning: Generalization and optimization

Z Zhou, S Athey, S Wager - Operations Research, 2023 - pubsonline.informs.org
In many settings, a decision maker wishes to learn a rule, or policy, that maps from
observable characteristics of an individual to an action. Examples include selecting offers …