Nonconvex optimization meets low-rank matrix factorization: An overview

Y Chi, YM Lu, Y Chen - IEEE Transactions on Signal …, 2019 - ieeexplore.ieee.org
Substantial progress has been made recently on develo** provably accurate and efficient
algorithms for low-rank matrix factorization via nonconvex optimization. While conventional …

Streaming PCA and subspace tracking: The missing data case

L Balzano, Y Chi, YM Lu - Proceedings of the IEEE, 2018 - ieeexplore.ieee.org
For many modern applications in science and engineering, data are collected in a streaming
fashion carrying time-varying information, and practitioners need to process them with a …

Spectral methods for data science: A statistical perspective

Y Chen, Y Chi, J Fan, C Ma - Foundations and Trends® in …, 2021 - nowpublishers.com
Spectral methods have emerged as a simple yet surprisingly effective approach for
extracting information from massive, noisy and incomplete data. In a nutshell, spectral …

Low-rank matrix completion: A contemporary survey

LT Nguyen, J Kim, B Shim - IEEE Access, 2019 - ieeexplore.ieee.org
As a paradigm to recover unknown entries of a matrix from partial observations, low-rank
matrix completion (LRMC) has generated a great deal of interest. Over the years, there have …

The power of preconditioning in overparameterized low-rank matrix sensing

X Xu, Y Shen, Y Chi, C Ma - International Conference on …, 2023 - proceedings.mlr.press
Abstract We propose $\textsf {ScaledGD ($\lambda $)} $, a preconditioned gradient descent
method to tackle the low-rank matrix sensing problem when the true rank is unknown, and …

Me-net: Towards effective adversarial robustness with matrix estimation

Y Yang, G Zhang, D Katabi, Z Xu - arxiv preprint arxiv:1905.11971, 2019 - arxiv.org
Deep neural networks are vulnerable to adversarial attacks. The literature is rich with
algorithms that can easily craft successful adversarial examples. In contrast, the …

Accelerating ill-conditioned low-rank matrix estimation via scaled gradient descent

T Tong, C Ma, Y Chi - Journal of Machine Learning Research, 2021 - jmlr.org
Low-rank matrix estimation is a canonical problem that finds numerous applications in signal
processing, machine learning and imaging science. A popular approach in practice is to …

A survey on nonconvex regularization-based sparse and low-rank recovery in signal processing, statistics, and machine learning

F Wen, L Chu, P Liu, RC Qiu - IEEE Access, 2018 - ieeexplore.ieee.org
In the past decade, sparse and low-rank recovery has drawn much attention in many areas
such as signal/image processing, statistics, bioinformatics, and machine learning. To …

Harnessing sparsity over the continuum: Atomic norm minimization for superresolution

Y Chi, MF Da Costa - IEEE Signal Processing Magazine, 2020 - ieeexplore.ieee.org
At the core of many sensing and imaging applications, the signal of interest can be modeled
as a linear superposition of translated or modulated versions of some template [eg, a point …

Recent theoretical advances in non-convex optimization

M Danilova, P Dvurechensky, A Gasnikov… - … and Probability: With a …, 2022 - Springer
Motivated by recent increased interest in optimization algorithms for non-convex
optimization in application to training deep neural networks and other optimization problems …