Gap safe screening rules for sparsity enforcing penalties

E Ndiaye, O Fercoq, J Salmon - Journal of Machine Learning Research, 2017 - jmlr.org
In high dimensional regression settings, sparsity enforcing penalties have proved useful to
regularize the data-fitting term. A recently introduced technique called screening rules …

Fast, blind, and accurate: Tuning-free sparse regression with global linear convergence

CM Verdun, O Melnyk, F Krahmer… - The Thirty Seventh …, 2024 - proceedings.mlr.press
Many algorithms for high-dimensional regression problems require the calibration of
regularization hyperparameters. This, in turn, often requires the knowledge of the unknown …

Perspective functions: Properties, constructions, and examples

PL Combettes - Set-Valued and Variational Analysis, 2018 - Springer
Many functions encountered in applied mathematics and in statistical data analysis can be
expressed in terms of perspective functions. One of the earliest examples is the Fisher …

Smooth over-parameterized solvers for non-smooth structured optimization

C Poon, G Peyré - Mathematical programming, 2023 - Springer
Non-smooth optimization is a core ingredient of many imaging or machine learning
pipelines. Non-smoothness encodes structural constraints on the solutions, such as sparsity …

Multi-subject MEG/EEG source imaging with sparse multi-task regression

H Janati, T Bazeille, B Thirion, M Cuturi, A Gramfort - NeuroImage, 2020 - Elsevier
Magnetoencephalography and electroencephalography (M/EEG) are non-invasive
modalities that measure the weak electromagnetic fields generated by neural activity …

[HTML][HTML] Perspective functions: Proximal calculus and applications in high-dimensional statistics

PL Combettes, CL Müller - Journal of Mathematical Analysis and …, 2018 - Elsevier
Perspective functions arise explicitly or implicitly in various forms in applied mathematics
and in statistical data analysis. To date, no systematic strategy is available to solve the …

Colide: Concomitant linear dag estimation

SS Saboksayr, G Mateos, M Tepper - arxiv preprint arxiv:2310.02895, 2023 - arxiv.org
We deal with the combinatorial problem of learning directed acyclic graph (DAG) structure
from observational data adhering to a linear structural equation model (SEM). Leveraging …

Perspective maximum likelihood-type estimation via proximal decomposition

PL Combettes, CL Müller - 2020 - projecteuclid.org
We introduce a flexible optimization model for maximum likelihood-type estimation (M-
estimation) that encompasses and generalizes a large class of existing statistical models …

Generalized concomitant multi-task lasso for sparse multimodal regression

M Massias, O Fercoq, A Gramfort… - International …, 2018 - proceedings.mlr.press
In high dimension, it is customary to consider Lasso-type estimators to enforce sparsity. For
standard Lasso theory to hold, the regularization parameter should be proportional to the …

Handling correlated and repeated measurements with the smoothed multivariate square-root Lasso

Q Bertrand, M Massias, A Gramfort… - Advances in Neural …, 2019 - proceedings.neurips.cc
A limitation of Lasso-type estimators is that the optimal regularization parameter depends on
the unknown noise level. Estimators such as the concomitant Lasso address this …