Banach space representer theorems for neural networks and ridge splines

R Parhi, RD Nowak - Journal of Machine Learning Research, 2021 - jmlr.org
We develop a variational framework to understand the properties of the functions learned by
neural networks fit to data. We propose and study a family of continuous-domain linear …

Neural reproducing kernel Banach spaces and representer theorems for deep networks

F Bartolucci, E De Vito, L Rosasco… - arxiv preprint arxiv …, 2024 - arxiv.org
Studying the function spaces defined by neural networks helps to understand the
corresponding learning models and their inductive bias. While in some limits neural …

[HTML][HTML] Sparsest piecewise-linear regression of one-dimensional data

T Debarre, Q Denoyelle, M Unser, J Fageot - Journal of Computational and …, 2022 - Elsevier
We study the problem of one-dimensional regression of data points with total-variation (TV)
regularization (in the sense of measures) on the second derivative, which is known to …

A Box-Spline Framework for Inverse Problems With Continuous-Domain Sparsity Constraints

M Pourya, A Boquet-Pujadas… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The formulation of inverse problems in the continuum eliminates discretization errors and
allows for the exact incorporation of priors. In this paper, we formulate a continuous-domain …

On the extremal points of the ball of the Benamou–Brenier energy

K Bredies, M Carioni, S Fanzon… - Bulletin of the London …, 2021 - Wiley Online Library
In this paper, we characterize the extremal points of the unit ball of the Benamou–Brenier
energy and of a coercive generalization of it, both subjected to the homogeneous continuity …

TV-based reconstruction of periodic functions

J Fageot, M Simeoni - Inverse Problems, 2020 - iopscience.iop.org
We introduce a general framework for the reconstruction of periodic multivariate functions
from finitely many and possibly noisy linear measurements. The reconstruction task is …

Sparsest univariate learning models under Lipschitz constraint

S Aziznejad, T Debarre, M Unser - IEEE Open Journal of Signal …, 2022 - ieeexplore.ieee.org
Beside the minimizationof the prediction error, two of the most desirable properties of a
regression scheme are stability and interpretability. Driven by these principles, we propose …

[PDF][PDF] Sparsest continuous piecewise-linear representation of data

T Debarre, Q Denoyelle, M Unser… - arxiv preprint arxiv …, 2020 - researchgate.net
We study the problem of interpolating one-dimensional data with total variation
regularization on the second derivative, which is known to promote piecewise-linear …

Continuous-domain formulation of inverse problems for composite sparse-plus-smooth signals

T Debarre, S Aziznejad, M Unser - IEEE Open Journal of Signal …, 2021 - ieeexplore.ieee.org
We present a novel framework for the reconstruction of 1D composite signals assumed to be
a mixture of two additive components, one sparse and the other smooth, given a finite …

The basins of attraction of the global minimizers of non-convex inverse problems with low-dimensional models in infinite dimension

Y Traonmilin, JF Aujol, A Leclaire - Information and Inference: A …, 2023 - academic.oup.com
Non-convex methods for linear inverse problems with low-dimensional models have
emerged as an alternative to convex techniques. We propose a theoretical framework where …