Majorization-minimization algorithms in signal processing, communications, and machine learning

Y Sun, P Babu, DP Palomar - IEEE Transactions on Signal …, 2016 - ieeexplore.ieee.org
This paper gives an overview of the majorization-minimization (MM) algorithmic framework,
which can provide guidance in deriving problem-driven algorithms with low computational …

On iteratively reweighted algorithms for nonsmooth nonconvex optimization in computer vision

P Ochs, A Dosovitskiy, T Brox, T Pock - SIAM Journal on Imaging Sciences, 2015 - SIAM
Natural image statistics indicate that we should use nonconvex norms for most
regularization tasks in image processing and computer vision. Still, they are rarely used in …

A Majorize-Minimize Subspace Approach for Image Regularization

E Chouzenoux, A Jezierska, JC Pesquet… - SIAM Journal on Imaging …, 2013 - SIAM
In this work, we consider a class of differentiable criteria for sparse image computing
problems, where a nonconvex regularization is applied to an arbitrary linear transform of the …

Parallel and distributed successive convex approximation methods for big-data optimization

A Nedić, JS Pang, G Scutari, Y Sun, G Scutari… - Multi-Agent Optimization …, 2018 - Springer
Recent years have witnessed a surge of interest in parallel and distributed optimization
methods for large-scale systems. In particular, nonconvex large-scale optimization problems …

Locating and quantifying gas emission sources using remotely obtained concentration data

B Hirst, P Jonathan, FG del Cueto, D Randell… - Atmospheric …, 2013 - Elsevier
We describe a method for detecting, locating and quantifying sources of gas emissions to
the atmosphere using remotely obtained gas concentration data; the method is applicable to …

A stochastic majorize-minimize subspace algorithm for online penalized least squares estimation

E Chouzenoux, JC Pesquet - IEEE Transactions on Signal …, 2017 - ieeexplore.ieee.org
Stochastic approximation techniques play an important role in solving many problems
encountered in machine learning or adaptive signal processing. In these contexts, the …

Why line search when you can plane search? so-friendly neural networks allow per-iteration optimization of learning and momentum rates for every layer

B Shea, M Schmidt - arxiv preprint arxiv:2406.17954, 2024 - arxiv.org
We introduce the class of SO-friendly neural networks, which include several models used in
practice including networks with 2 layers of hidden weights where the number of inputs is …

Efficient variational Bayesian approximation method based on subspace optimization

Y Zheng, A Fraysse, T Rodet - IEEE Transactions on Image …, 2014 - ieeexplore.ieee.org
Variational Bayesian approximations have been widely used in fully Bayesian inference for
approximating an intractable posterior distribution by a separable one. Nevertheless, the …

Block delayed Majorize-Minimize subspace algorithm for large scale image restoration

M Chalvidal, E Chouzenoux, JB Fest, C Lefort - Inverse Problems, 2023 - iopscience.iop.org
In this work, we propose an asynchronous Majorization-Minimization (MM) algorithm for
solving large scale differentiable non-convex optimization problems. The proposed …

A majorize-minimize memory gradient method for complex-valued inverse problems

A Florescu, E Chouzenoux, JC Pesquet, P Ciuciu… - Signal Processing, 2014 - Elsevier
Complex-valued data are encountered in many application areas of signal and image
processing. In the context of the optimization of functions of real variables, subspace …