A survey on some recent developments of alternating direction method of multipliers

DR Han - Journal of the Operations Research Society of China, 2022 - Springer
Recently, alternating direction method of multipliers (ADMM) attracts much attentions from
various fields and there are many variant versions tailored for different models. Moreover, its …

A Review of multilayer extreme learning machine neural networks

JA Vásquez-Coronel, M Mora, K Vilches - Artificial Intelligence Review, 2023 - Springer
Abstract The Extreme Learning Machine is a single-hidden-layer feedforward learning
algorithm, which has been successfully applied in regression and classification problems in …

Majorization-minimization algorithms in signal processing, communications, and machine learning

Y Sun, P Babu, DP Palomar - IEEE Transactions on Signal …, 2016 - ieeexplore.ieee.org
This paper gives an overview of the majorization-minimization (MM) algorithmic framework,
which can provide guidance in deriving problem-driven algorithms with low computational …

An introduction to continuous optimization for imaging

A Chambolle, T Pock - Acta Numerica, 2016 - cambridge.org
A large number of imaging problems reduce to the optimization of a cost function, with
typical structural properties. The aim of this paper is to describe the state of the art in …

An inertial forward-backward algorithm for monotone inclusions

DA Lorenz, T Pock - Journal of Mathematical Imaging and Vision, 2015 - Springer
In this paper, we propose an inertial forward-backward splitting algorithm to compute a zero
of the sum of two monotone operators, with one of the two operators being co-coercive. The …

iPiano: Inertial proximal algorithm for nonconvex optimization

P Ochs, Y Chen, T Brox, T Pock - SIAM Journal on Imaging Sciences, 2014 - SIAM
In this paper we study an algorithm for solving a minimization problem composed of a
differentiable (possibly nonconvex) and a convex (possibly nondifferentiable) function. The …

Splitting methods with variable metric for Kurdyka–Łojasiewicz functions and general convergence rates

P Frankel, G Garrigos, J Peypouquet - Journal of Optimization Theory and …, 2015 - Springer
We study the convergence of general descent methods applied to a lower semi-continuous
and nonconvex function, which satisfies the Kurdyka–Łojasiewicz inequality in a Hilbert …

On iteratively reweighted algorithms for nonsmooth nonconvex optimization in computer vision

P Ochs, A Dosovitskiy, T Brox, T Pock - SIAM Journal on Imaging Sciences, 2015 - SIAM
Natural image statistics indicate that we should use nonconvex norms for most
regularization tasks in image processing and computer vision. Still, they are rarely used in …

A block coordinate variable metric forward–backward algorithm

E Chouzenoux, JC Pesquet, A Repetti - Journal of Global Optimization, 2016 - Springer
A number of recent works have emphasized the prominent role played by the Kurdyka-
Łojasiewicz inequality for proving the convergence of iterative algorithms solving possibly …

An inertial forward–backward algorithm for the minimization of the sum of two nonconvex functions

RI Boţ, ER Csetnek, SC László - EURO Journal on Computational …, 2016 - Springer
We propose a forward–backward proximal-type algorithm with inertial/memory effects for
minimizing the sum of a nonsmooth function with a smooth one in the nonconvex setting …