Spectral methods for data science: A statistical perspective
Spectral methods have emerged as a simple yet surprisingly effective approach for
extracting information from massive, noisy and incomplete data. In a nutshell, spectral …
extracting information from massive, noisy and incomplete data. In a nutshell, spectral …
High-dimensional limit theorems for sgd: Effective dynamics and critical scaling
We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in
the high-dimensional regime. We prove limit theorems for the trajectories of summary …
the high-dimensional regime. We prove limit theorems for the trajectories of summary …
A unifying tutorial on approximate message passing
Over the last decade or so, Approximate Message Passing (AMP) algorithms have become
extremely popular in various structured high-dimensional statistical problems. Although the …
extremely popular in various structured high-dimensional statistical problems. Although the …
Hutch++: Optimal stochastic trace estimation
We study the problem of estimating the trace of a matrix A that can only be accessed through
matrix-vector multiplication. We introduce a new randomized algorithm, Hutch++, which …
matrix-vector multiplication. We introduce a new randomized algorithm, Hutch++, which …
Notes on computational hardness of hypothesis testing: Predictions using the low-degree likelihood ratio
These notes survey and explore an emerging method, which we call the low-degree
method, for understanding statistical-versus-computational tradeoffs in high-dimensional …
method, for understanding statistical-versus-computational tradeoffs in high-dimensional …
The Franz-Parisi criterion and computational trade-offs in high dimensional statistics
Many high-dimensional statistical inference problems are believed to possess inherent
computational hardness. Various frameworks have been proposed to give rigorous …
computational hardness. Various frameworks have been proposed to give rigorous …
A precise high-dimensional asymptotic theory for boosting and minimum--norm interpolated classifiers
A precise high-dimensional asymptotic theory for boosting and minimum-l1-norm
interpolated classifiers Page 1 The Annals of Statistics 2022, Vol. 50, No. 3, 1669–1695 …
interpolated classifiers Page 1 The Annals of Statistics 2022, Vol. 50, No. 3, 1669–1695 …
The low-rank hypothesis of complex systems
Complex systems are high-dimensional nonlinear dynamical systems with heterogeneous
interactions among their constituents. To make interpretable predictions about their large …
interactions among their constituents. To make interpretable predictions about their large …
Computational barriers to estimation from low-degree polynomials
Computational barriers to estimation from low-degree polynomials Page 1 The Annals of
Statistics 2022, Vol. 50, No. 3, 1833–1858 https://doi.org/10.1214/22-AOS2179 © Institute of …
Statistics 2022, Vol. 50, No. 3, 1833–1858 https://doi.org/10.1214/22-AOS2179 © Institute of …
Statistical query algorithms and low-degree tests are almost equivalent
Researchers currently use a number of approaches to predict and substantiate information-
computation gaps in high-dimensional statistical estimation problems. A prominent …
computation gaps in high-dimensional statistical estimation problems. A prominent …