Proximal splitting algorithms for convex optimization: A tour of recent advances, with new twists

L Condat, D Kitahara, A Contreras, A Hirabayashi - SIAM Review, 2023 - SIAM
Convex nonsmooth optimization problems, whose solutions live in very high dimensional
spaces, have become ubiquitous. To solve them, the class of first-order algorithms known as …

Randprox: Primal-dual optimization algorithms with randomized proximal updates

L Condat, P Richtárik - arxiv preprint arxiv:2207.12891, 2022 - arxiv.org
Proximal splitting algorithms are well suited to solving large-scale nonsmooth optimization
problems, in particular those arising in machine learning. We propose a new primal-dual …

Phase retrieval with Bregman divergences and application to audio signal recovery

PH Vial, P Magron, T Oberlin… - IEEE Journal of Selected …, 2021 - ieeexplore.ieee.org
Phase retrieval (PR) aims to recover a signal from the magnitudes of a set of inner products.
This problem arises in many audio signal processing applications which operate on a short …

[HTML][HTML] Perspective functions: Proximal calculus and applications in high-dimensional statistics

PL Combettes, CL Müller - Journal of Mathematical Analysis and …, 2018 - Elsevier
Perspective functions arise explicitly or implicitly in various forms in applied mathematics
and in statistical data analysis. To date, no systematic strategy is available to solve the …

Safe screening for sparse regression with the Kullback-Leibler divergence

CF Dantas, E Soubies, C Févotte - Icassp 2021-2021 ieee …, 2021 - ieeexplore.ieee.org
Safe screening rules are powerful tools to accelerate iterative solvers in sparse regression
problems. They allow early identification of inactive coordinates (ie, those not belonging to …

Efficient constrained signal reconstruction by randomized epigraphical projection

S Ono - ICASSP 2019-2019 IEEE International Conference on …, 2019 - ieeexplore.ieee.org
This paper proposes a randomized optimization framework for constrained signal
reconstruction, where the word" constrained" implies that data-fidelity is imposed as a hard …

A simple linear convergence analysis of the point-saga algorithm

L Condat, P Richtárik - arxiv preprint arxiv:2405.19951, 2024 - arxiv.org
Point-SAGA is a randomized algorithm for minimizing a sum of convex functions using their
proximity operators (proxs), proposed by Defazio (2016). At every iteration, the prox of only …

[PDF][PDF] Proximal splitting algorithms: Relax them all

L Condat, D Kitahara, A Contreras… - arxiv preprint arxiv …, 2019 - optimization-online.org
Convex optimization problems, whose solutions live in very high dimensional spaces, have
become ubiquitous. To solve them, proximal splitting algorithms are particularly adequate …

Distributed Normal Map-based Stochastic Proximal Gradient Methods over Networks

K Huang, S Pu, A Nedić - arxiv preprint arxiv:2412.13054, 2024 - arxiv.org
Consider $ n $ agents connected over a network collaborate to minimize the average of their
local cost functions combined with a common nonsmooth function. This paper introduces a …

Proximity Operators of Perspective Functions with Nonlinear Scaling

LM Briceno-Arias, PL Combettes, FJ Silva - SIAM Journal on Optimization, 2024 - SIAM
A perspective function is a construction which combines a base function defined on a given
space with a nonlinear scaling function defined on another space and which yields a lower …