Spectral methods for data science: A statistical perspective

Y Chen, Y Chi, J Fan, C Ma - Foundations and Trends® in …, 2021 - nowpublishers.com
Spectral methods have emerged as a simple yet surprisingly effective approach for
extracting information from massive, noisy and incomplete data. In a nutshell, spectral …

High-dimensional limit theorems for sgd: Effective dynamics and critical scaling

G Ben Arous, R Gheissari… - Advances in Neural …, 2022 - proceedings.neurips.cc
We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in
the high-dimensional regime. We prove limit theorems for the trajectories of summary …

A unifying tutorial on approximate message passing

OY Feng, R Venkataramanan, C Rush… - … and Trends® in …, 2022 - nowpublishers.com
Over the last decade or so, Approximate Message Passing (AMP) algorithms have become
extremely popular in various structured high-dimensional statistical problems. Although the …

Hutch++: Optimal stochastic trace estimation

RA Meyer, C Musco, C Musco, DP Woodruff - Symposium on Simplicity in …, 2021 - SIAM
We study the problem of estimating the trace of a matrix A that can only be accessed through
matrix-vector multiplication. We introduce a new randomized algorithm, Hutch++, which …

Notes on computational hardness of hypothesis testing: Predictions using the low-degree likelihood ratio

D Kunisky, AS Wein, AS Bandeira - ISAAC Congress (International Society …, 2019 - Springer
These notes survey and explore an emerging method, which we call the low-degree
method, for understanding statistical-versus-computational tradeoffs in high-dimensional …

The Franz-Parisi criterion and computational trade-offs in high dimensional statistics

AS Bandeira, A El Alaoui, S Hopkins… - Advances in …, 2022 - proceedings.neurips.cc
Many high-dimensional statistical inference problems are believed to possess inherent
computational hardness. Various frameworks have been proposed to give rigorous …

A precise high-dimensional asymptotic theory for boosting and minimum--norm interpolated classifiers

T Liang, P Sur - The Annals of Statistics, 2022 - projecteuclid.org
A precise high-dimensional asymptotic theory for boosting and minimum-l1-norm
interpolated classifiers Page 1 The Annals of Statistics 2022, Vol. 50, No. 3, 1669–1695 …

The low-rank hypothesis of complex systems

V Thibeault, A Allard, P Desrosiers - Nature Physics, 2024 - nature.com
Complex systems are high-dimensional nonlinear dynamical systems with heterogeneous
interactions among their constituents. To make interpretable predictions about their large …

Computational barriers to estimation from low-degree polynomials

T Schramm, AS Wein - The Annals of Statistics, 2022 - projecteuclid.org
Computational barriers to estimation from low-degree polynomials Page 1 The Annals of
Statistics 2022, Vol. 50, No. 3, 1833–1858 https://doi.org/10.1214/22-AOS2179 © Institute of …

Statistical query algorithms and low-degree tests are almost equivalent

M Brennan, G Bresler, SB Hopkins, J Li… - arxiv preprint arxiv …, 2020 - arxiv.org
Researchers currently use a number of approaches to predict and substantiate information-
computation gaps in high-dimensional statistical estimation problems. A prominent …