Improved global guarantees for the nonconvex burer–monteiro factorization via rank overparameterization

RY Zhang - Mathematical Programming, 2024 - Springer
We consider minimizing a twice-differentiable, L-smooth, and\(\mu\)-strongly convex
objective\(\phi\) over an\(n\times n\) positive semidefinite matrix\(M\succeq 0\), under the …

The loss landscape of deep linear neural networks: a second-order analysis

EM Achour, F Malgouyres, S Gerchinovitz - Journal of Machine Learning …, 2024 - jmlr.org
We study the optimization landscape of deep linear neural networks with square loss. It is
known that, under weak assumptions, there are no spurious local minima and no local …

The landscape of deterministic and stochastic optimal control problems: one-shot optimization versus dynamic programming

J Kim, Y Ding, Y Bi, J Lavaei - IEEE Transactions on Automatic …, 2024 - ieeexplore.ieee.org
Optimal control problems can be solved via a one-shot (single) optimization or a sequence
of optimization using dynamic programming (DP). However, the computation of their global …

Learning of dynamical systems under adversarial attacks

H Feng, J Lavaei - 2021 60th IEEE Conference on Decision …, 2021 - ieeexplore.ieee.org
We study the identification of a linear time-invariant dynamical system affected by large-and-
sparse disturbances modeling adversarial attacks or faults. Under the assumption that the …

Global and local analyses of nonlinear low-rank matrix recovery problems

Y Bi, J Lavaei - arxiv preprint arxiv:2010.04349, 2020 - arxiv.org
The restricted isometry property (RIP) is a well-known condition that guarantees the absence
of spurious local minima in low-rank matrix recovery problems with linear measurements. In …

Learning of dynamical systems under adversarial attacks-null space property perspective

H Feng, B Yalcin, J Lavaei - 2023 American Control …, 2023 - ieeexplore.ieee.org
We study the identification of a linear time-invariant dynamical system affected by large-and-
sparse disturbances modeling adversarial attacks or faults. Under the assumption that the …

A MILP for optimal measurement choice in robust power grid state estimation

E Glista, S Sojoudi - 2022 IEEE Power & Energy Society …, 2022 - ieeexplore.ieee.org
The reliability of the electric power grid is increasingly linked to the reliability of measured
data which is used to understand the current state of the system. Determining the current …

No spurious solutions in non-convex matrix sensing: Structure compensates for isometry

I Molybog, S Sojoudi, J Lavaei - 2021 American Control …, 2021 - ieeexplore.ieee.org
The paper is concerned with the theoretical explanation of the recent empirical success of
solving the low-rank matrix sensing problem via nonconvex optimization. It is known that …

Quelques contributions à la théorie de l'apprentissage profond: optimisation, robustesse et approximation

EM Achour - 2022 - theses.hal.science
Dans cette thèse, nous étudions différents aspects théoriques de l'apprentissage profond,
en particulier l'optimisation, la robustesse et l'approximation. Optimisation: Nous étudions le …

Analysis of spurious local solutions of optimal control problems: One-shot optimization versus dynamic programming

Y Ding, Y Bi, J Lavaei - 2021 American Control Conference …, 2021 - ieeexplore.ieee.org
Dynamic programming (DP) has a rich theoretical foundation and a broad range of
applications, especially in the classic area of optimal control and the recent area of …