Stein Unbiased GrAdient estimator of the Risk (SUGAR) for multiple parameter selection

CA Deledalle, S Vaiter, J Fadili, G Peyré - SIAM Journal on Imaging Sciences, 2014 - SIAM
Algorithms for solving variational regularization of ill-posed inverse problems usually involve
operators that depend on a collection of continuous parameters. When the operators enjoy …

A generalized least-square matrix decomposition

GI Allen, L Grosenick, J Taylor - Journal of the American Statistical …, 2014 - Taylor & Francis
Variables in many big-data settings are structured, arising, for example, from measurements
on a regular grid as in imaging and time series or from spatial-temporal measurements as in …

Sparse estimation via nonconcave penalized likelihood in factor analysis model

K Hirose, M Yamamoto - Statistics and Computing, 2015 - Springer
We consider the problem of sparse estimation in a factor analysis model. A traditional
estimation procedure in use is the following two-step approach: the model is estimated by …

Effective degrees of freedom: a flawed metaphor

L Janson, W Fithian, TJ Hastie - Biometrika, 2015 - academic.oup.com
To most applied statisticians, a fitting procedure's degrees of freedom is synonymous with its
model complexity, or its capacity for overfitting to data. In particular, the degrees of freedom …

Out-of-sample error estimation for M-estimators with convex penalty

PC Bellec - Information and Inference: A Journal of the IMA, 2023 - academic.oup.com
A generic out-of-sample error estimate is proposed for-estimators regularized with a convex
penalty in high-dimensional linear regression where is observed and the dimension and …

A pliable lasso

R Tibshirani, J Friedman - Journal of Computational and Graphical …, 2020 - Taylor & Francis
We propose a generalization of the lasso that allows the model coefficients to vary as a
function of a general set of some prespecified modifying variables. These modifiers might be …

The degrees of freedom of partly smooth regularizers

S Vaiter, C Deledalle, J Fadili, G Peyré… - Annals of the Institute of …, 2017 - Springer
We study regularized regression problems where the regularizer is a proper, lower-
semicontinuous, convex and partly smooth function relative to a Riemannian submanifold …

On degrees of freedom of projection estimators with applications to multivariate nonparametric regression

X Chen, Q Lin, B Sen - Journal of the American Statistical …, 2020 - Taylor & Francis
In this article, we consider the nonparametric regression problem with multivariate
predictors. We provide a characterization of the degrees of freedom and divergence for …

Automated data-driven selection of the hyperparameters for total-variation-based texture segmentation

B Pascal, S Vaiter, N Pustelnik, P Abry - Journal of Mathematical Imaging …, 2021 - Springer
Penalized least squares are widely used in signal and image processing. Yet, it suffers from
a major limitation since it requires fine-tuning of the regularization parameters. Under …

Risk consistency of cross-validation with lasso-type procedures

D Homrighausen, DJ McDonald - Statistica Sinica, 2017 - JSTOR
The lasso and related sparsity inducing algorithms have been the target of substantial
theoretical and applied research. Correspondingly, many results are known about their …