Complete dictionary recovery over the sphere I: Overview and the geometric picture

J Sun, Q Qu, J Wright - IEEE Transactions on Information …, 2016 - ieeexplore.ieee.org
We consider the problem of recovering a complete (ie, square and invertible) matrix A 0,
from Y∈ R n× p with Y= A 0 X 0, provided X 0 is sufficiently sparse. This recovery problem is …

Non-convex optimization for machine learning

P Jain, P Kar - Foundations and Trends® in Machine …, 2017 - nowpublishers.com
A vast majority of machine learning algorithms train their models and perform inference by
solving optimization problems. In order to capture the learning and prediction problems …

A geometric analysis of phase retrieval

J Sun, Q Qu, J Wright - Foundations of Computational Mathematics, 2018 - Springer
Can we recover a complex signal from its Fourier magnitudes? More generally, given a set
of m measurements, y_k=\left| a _k^* x\right| yk= ak∗ x for k= 1, ..., mk= 1,…, m, is it possible …

Feature purification: How adversarial training performs robust deep learning

Z Allen-Zhu, Y Li - 2021 IEEE 62nd Annual Symposium on …, 2022 - ieeexplore.ieee.org
Despite the empirical success of using adversarial training to defend deep learning models
against adversarial perturbations, so far, it still remains rather unclear what the principles are …

Variance reduction for faster non-convex optimization

Z Allen-Zhu, E Hazan - International conference on machine …, 2016 - proceedings.mlr.press
We consider the fundamental problem in non-convex optimization of efficiently reaching a
stationary point. In contrast to the convex case, in the long history of this basic problem, the …

An analysis of the t-sne algorithm for data visualization

S Arora, W Hu, PK Kothari - Conference on learning theory, 2018 - proceedings.mlr.press
A first line of attack in exploratory data analysis is\emph {data visualization}, ie, generating a
2-dimensional representation of data that makes\emph {clusters} of similar points visually …

A statistical perspective on algorithmic leveraging

P Ma, M Mahoney, B Yu - International conference on …, 2014 - proceedings.mlr.press
One popular method for dealing with large-scale data sets is sampling. Using the empirical
statistical leverage scores as an importance sampling distribution, the method of algorithmic …

Provable bounds for learning some deep representations

S Arora, A Bhaskara, R Ge… - … conference on machine …, 2014 - proceedings.mlr.press
We give algorithms with provable guarantees that learn a class of deep nets in the
generative model view popularized by Hinton and others. Our generative model is an n …

Cross-node federated graph neural network for spatio-temporal data modeling

C Meng, S Rambhatla, Y Liu - Proceedings of the 27th ACM SIGKDD …, 2021 - dl.acm.org
Vast amount of data generated from networks of sensors, wearables, and the Internet of
Things (IoT) devices underscores the need for advanced modeling techniques that leverage …

Sparse modeling for image and vision processing

J Mairal, F Bach, J Ponce - Foundations and Trends® in …, 2014 - nowpublishers.com
In recent years, a large amount of multi-disciplinary research has been conducted on sparse
models and their applications. In statistics and machine learning, the sparsity principle is …