Majorization-minimization algorithms in signal processing, communications, and machine learning
This paper gives an overview of the majorization-minimization (MM) algorithmic framework,
which can provide guidance in deriving problem-driven algorithms with low computational …
which can provide guidance in deriving problem-driven algorithms with low computational …
On iteratively reweighted algorithms for nonsmooth nonconvex optimization in computer vision
Natural image statistics indicate that we should use nonconvex norms for most
regularization tasks in image processing and computer vision. Still, they are rarely used in …
regularization tasks in image processing and computer vision. Still, they are rarely used in …
A Majorize-Minimize Subspace Approach for Image Regularization
In this work, we consider a class of differentiable criteria for sparse image computing
problems, where a nonconvex regularization is applied to an arbitrary linear transform of the …
problems, where a nonconvex regularization is applied to an arbitrary linear transform of the …
Parallel and distributed successive convex approximation methods for big-data optimization
Recent years have witnessed a surge of interest in parallel and distributed optimization
methods for large-scale systems. In particular, nonconvex large-scale optimization problems …
methods for large-scale systems. In particular, nonconvex large-scale optimization problems …
Locating and quantifying gas emission sources using remotely obtained concentration data
We describe a method for detecting, locating and quantifying sources of gas emissions to
the atmosphere using remotely obtained gas concentration data; the method is applicable to …
the atmosphere using remotely obtained gas concentration data; the method is applicable to …
A stochastic majorize-minimize subspace algorithm for online penalized least squares estimation
Stochastic approximation techniques play an important role in solving many problems
encountered in machine learning or adaptive signal processing. In these contexts, the …
encountered in machine learning or adaptive signal processing. In these contexts, the …
Why line search when you can plane search? so-friendly neural networks allow per-iteration optimization of learning and momentum rates for every layer
We introduce the class of SO-friendly neural networks, which include several models used in
practice including networks with 2 layers of hidden weights where the number of inputs is …
practice including networks with 2 layers of hidden weights where the number of inputs is …
Efficient variational Bayesian approximation method based on subspace optimization
Variational Bayesian approximations have been widely used in fully Bayesian inference for
approximating an intractable posterior distribution by a separable one. Nevertheless, the …
approximating an intractable posterior distribution by a separable one. Nevertheless, the …
Block delayed Majorize-Minimize subspace algorithm for large scale image restoration
In this work, we propose an asynchronous Majorization-Minimization (MM) algorithm for
solving large scale differentiable non-convex optimization problems. The proposed …
solving large scale differentiable non-convex optimization problems. The proposed …
A majorize-minimize memory gradient method for complex-valued inverse problems
Complex-valued data are encountered in many application areas of signal and image
processing. In the context of the optimization of functions of real variables, subspace …
processing. In the context of the optimization of functions of real variables, subspace …