Best practices for comparing optimization algorithms

V Beiranvand, W Hare, Y Lucet - Optimization and Engineering, 2017 - Springer
Comparing, or benchmarking, of optimization algorithms is a complicated task that involves
many subtle considerations to yield a fair and unbiased evaluation. In this paper, we …

Proximally guided stochastic subgradient method for nonsmooth, nonconvex problems

D Davis, B Grimmer - SIAM Journal on Optimization, 2019 - SIAM
In this paper, we introduce a stochastic projected subgradient method for weakly convex (ie,
uniformly prox-regular) nonsmooth, nonconvex functions---a wide class of functions which …

A unified analysis of descent sequences in weakly convex optimization, including convergence rates for bundle methods

F Atenas, C Sagastizábal, PJS Silva, M Solodov - SIAM Journal on …, 2023 - SIAM
We present a framework for analyzing convergence and local rates of convergence of a
class of descent algorithms, assuming the objective function is weakly convex. The …

Optimal convergence rates for the proximal bundle method

M Díaz, B Grimmer - SIAM Journal on Optimization, 2023 - SIAM
We study convergence rates of the classic proximal bundle method for a variety of
nonsmooth convex optimization problems. We show that, without any modification, this …

A proximal bundle method for nonsmooth nonconvex functions with inexact information

W Hare, C Sagastizábal, M Solodov - Computational Optimization and …, 2016 - Springer
For a class of nonconvex nonsmooth functions, we consider the problem of computing an
approximate critical point, in the case when only inexact information about the function and …

Proximal bundle methods for nonsmooth DC programming

W de Oliveira - Journal of Global Optimization, 2019 - Springer
We consider the problem of minimizing the difference of two nonsmooth convex functions
over a simple convex set. To deal with this class of nonsmooth and nonconvex optimization …

Progressive decoupling of linkages in optimization and variational inequalities with elicitable convexity or monotonicity

RT Rockafellar - Set-Valued and Variational Analysis, 2019 - Springer
Algorithms for problem decomposition and splitting in optimization and the solving of
variational inequalities have largely depended on assumptions of convexity or monotonicity …

A Sequential Quadratic Programming Algorithm for Nonsmooth Problems with Upper- Objective

J Wang, CG Petra - SIAM Journal on Optimization, 2023 - SIAM
An optimization algorithm for nonsmooth nonconvex constrained optimization problems with
upper-objective functions is proposed and analyzed. Upper-is a weakly concave property …

First-order methods for nonsmooth nonconvex functional constrained optimization with or without slater points

Z Jia, B Grimmer - arxiv preprint arxiv:2212.00927, 2022 - arxiv.org
Constrained optimization problems where both the objective and constraints may be
nonsmooth and nonconvex arise across many learning and data science settings. In this …

Long term dynamics of the subgradient method for Lipschitz path differentiable functions

J Bolte, E Pauwels, R Rios-Zertuche - Journal of the European …, 2022 - ems.press
We consider the long-term dynamics of the vanishing stepsize subgradient method in the
case when the objective function is neither smooth nor convex. We assume that this function …