Lasso with non-linear measurements is equivalent to one with linear measurements

C Thrampoulidis, E Abbasi… - Advances in Neural …, 2015 - proceedings.neurips.cc
Consider estimating an unknown, but structured (eg sparse, low-rank, etc.), signal $ x_0\in
R^ n $ from a vector $ y\in R^ m $ of measurements of the form $ y_i= g_i (a_i^ Tx_0) …

L1-regularized least squares for support recovery of high dimensional single index models with gaussian designs

M Neykov, JS Liu, T Cai - Journal of Machine Learning Research, 2016 - jmlr.org
It is known that for a certain class of single index models (SIMs) Y= f (X p× 1T β0, ε), support
recovery is impossible when X∼ N (0; I p× p) and a model complexity adjusted sample size …

Optimal combination of linear and spectral estimators for generalized linear models

M Mondelli, C Thrampoulidis… - Foundations of …, 2022 - Springer
We study the problem of recovering an unknown signal x given measurements obtained
from a generalized linear model with a Gaussian sensing matrix. Two popular solutions are …

Structured signal recovery from non-linear and heavy-tailed measurements

L Goldstein, S Minsker, X Wei - IEEE Transactions on …, 2018 - ieeexplore.ieee.org
We study high-dimensional signal recovery from non-linear measurements with design
vectors having elliptically symmetric distribution. Special attention is devoted to the situation …

Fast algorithms for demixing sparse signals from nonlinear observations

M Soltani, C Hegde - IEEE Transactions on Signal Processing, 2017 - ieeexplore.ieee.org
We study the problem of demixing a pair of sparse signals from noisy, nonlinear
observations of their superposition. Mathematically, we consider a nonlinear signal …

Misspecified nonconvex statistical optimization for sparse phase retrieval

Z Yang, LF Yang, EX Fang, T Zhao, Z Wang… - Mathematical …, 2019 - Springer
Existing nonconvex statistical optimization theory and methods crucially rely on the correct
specification of the underlying “true” statistical models. To address this issue, we take a first …

[PDF][PDF] Learning non-gaussian multi-index model via second-order stein's method

Z Yang, K Balasubramanian… - Advances in Neural …, 2017 - proceedings.neurips.cc
We consider estimating the parametric components of semiparametric multi-index models in
high dimensions. To bypass the requirements of Gaussianity or elliptical symmetry of …

High-dimensional Gaussian copula regression: Adaptive estimation and statistical inference

TT Cai, L Zhang - Statistica Sinica, 2018 - JSTOR
We develop adaptive estimation and inference methods for high-dimensional Gaussian
copula regression that achieve the same optimality without the knowledge of the marginal …

Single-index models in the high signal regime

A Pananjady, DP Foster - IEEE Transactions on Information …, 2021 - ieeexplore.ieee.org
A single-index model is given by y= g*(< x, θ*>)+ ε: The scalar response y depends on the
covariate vector x both through an unknown (vector) parameter θ* as well as an unknown …

High dimensional m-estimation with missing outcomes: A semi-parametric framework

A Chakrabortty, J Lu, TT Cai, H Li - arxiv preprint arxiv:1911.11345, 2019 - arxiv.org
We consider high dimensional $ M $-estimation in settings where the response $ Y $ is
possibly missing at random and the covariates $\mathbf {X}\in\mathbb {R}^ p $ can be high …