Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with O (1/k^ 2) Rate on Squared Gradient Norm

TH Yoon, EK Ryu - International Conference on Machine …, 2021 - proceedings.mlr.press
In this work, we study the computational complexity of reducing the squared gradient
magnitude for smooth minimax optimization problems. First, we present algorithms with …

Accelerated primal-dual gradient method for smooth and convex-concave saddle-point problems with bilinear coupling

D Kovalev, A Gasnikov… - Advances in Neural …, 2022 - proceedings.neurips.cc
In this paper we study the convex-concave saddle-point problem $\min_x\max_y f (x)+
y^\top\mathbf {A} xg (y) $, where $ f (x) $ and $ g (y) $ are smooth and convex functions. We …

Optimal gradient sliding and its application to optimal distributed optimization under similarity

D Kovalev, A Beznosikov, E Borodich… - Advances in …, 2022 - proceedings.neurips.cc
We study structured convex optimization problems, with additive objective $ r:= p+ q $,
where $ r $ is ($\mu $-strongly) convex, $ q $ is $ L_q $-smooth and convex, and $ p $ is …

Lifted primal-dual method for bilinearly coupled smooth minimax optimization

KK Thekumparampil, N He… - … Conference on Artificial …, 2022 - proceedings.mlr.press
We study the bilinearly coupled minimax problem: $\min_ {x}\max_ {y} f (x)+ y^\top A xh (y) $,
where $ f $ and $ h $ are both strongly convex smooth functions and admit first-order …

Stochastic distributed optimization under average second-order similarity: Algorithms and analysis

D Lin, Y Han, H Ye, Z Zhang - Advances in Neural …, 2024 - proceedings.neurips.cc
We study finite-sum distributed optimization problems involving a master node and $ n-1$
local nodes under the popular $\delta $-similarity and $\mu $-strong convexity conditions …

Smooth monotone stochastic variational inequalities and saddle point problems: A survey

A Beznosikov, B Polyak, E Gorbunov… - European Mathematical …, 2023 - ems.press
This paper is a survey of methods for solving smooth,(strongly) monotone stochastic
variational inequalities. To begin with, we present the deterministic foundation from which …

On accelerated methods for saddle-point problems with composite structure

V Tominin, Y Tominin, E Borodich, D Kovalev… - arxiv preprint arxiv …, 2021 - arxiv.org
We consider strongly-convex-strongly-concave saddle-point problems with general non-
bilinear objective and different condition numbers with respect to the primal and the dual …

Accelerated minimax algorithms flock together

TH Yoon, EK Ryu - SIAM Journal on Optimization, 2025 - SIAM
Several new accelerated methods in minimax optimization and fixed-point iterations have
recently been discovered, and, interestingly, they rely on a mechanism distinct from …

Decentralized saddle-point problems with different constants of strong convexity and strong concavity

D Metelev, A Rogozin, A Gasnikov… - Computational …, 2024 - Springer
Large-scale saddle-point problems arise in such machine learning tasks as GANs and linear
models with affine constraints. In this paper, we study distributed saddle-point problems with …

Generalized mirror prox algorithm for monotone variational inequalities: Universality and inexact oracle

F Stonyakin, A Gasnikov, P Dvurechensky… - Journal of Optimization …, 2022 - Springer
We introduce an inexact oracle model for variational inequalities with monotone operators,
propose a numerical method that solves such variational inequalities, and analyze its …