Smooth monotone stochastic variational inequalities and saddle point problems: A survey

A Beznosikov, B Polyak, E Gorbunov… - European Mathematical …, 2023 - ems.press
This paper is a survey of methods for solving smooth,(strongly) monotone stochastic
variational inequalities. To begin with, we present the deterministic foundation from which …

Distributionally robust optimization via ball oracle acceleration

Y Carmon, D Hausler - Advances in Neural Information …, 2022 - proceedings.neurips.cc
We develop and analyze algorithms for distributionally robust optimization (DRO) of convex
losses. In particular, we consider group-structured and bounded $ f $-divergence uncertainty …

Accelerated cyclic coordinate dual averaging with extrapolation for composite convex optimization

CY Lin, C Song, J Diakonikolas - … Conference on Machine …, 2023 - proceedings.mlr.press
Exploiting partial first-order information in a cyclic way is arguably the most natural strategy
to obtain scalable first-order methods. However, despite their wide use in practice, cyclic …

On the complexity of a practical primal-dual coordinate method

A Alacaoglu, V Cevher, SJ Wright - arxiv preprint arxiv:2201.07684, 2022 - arxiv.org
We prove complexity bounds for the primal-dual algorithm with random extrapolation and
coordinate descent (PURE-CD), which has been shown to obtain good practical …

A whole new ball game: A primal accelerated method for matrix games and minimizing the maximum of smooth functions

Y Carmon, A Jambulapati, Y **, A Sidford - … of the 2024 Annual ACM-SIAM …, 2024 - SIAM
We design algorithms for minimizing max i∈[n] fi (x) over ad-dimensional Euclidean or
simplex domain. When each fi is 1-Lipschitz and 1-smooth, our method computes an ɛ …

Efficient stochastic approximation of minimax excess risk optimization

L Zhang, H Bai, WW Tu, P Yang, Y Hu - arxiv preprint arxiv:2306.00026, 2023 - arxiv.org
While traditional distributionally robust optimization (DRO) aims to minimize the maximal risk
over a set of distributions, Agarwal and Zhang (2022) recently proposed a variant that …

[PDF][PDF] DRAGO: Primal-Dual Coupled Variance Reduction for Faster Distributionally Robust Optimization

R Mehta, J Diakonikolas… - The Thirty-eighth Annual …, 2024 - proceedings.neurips.cc
We consider the penalized distributionally robust optimization (DRO) problem with a closed,
convex uncertainty set, a setting that encompasses learning using f-DRO and spectral/L-risk …

A Primal-Dual Algorithm for Faster Distributionally Robust Optimization

R Mehta, J Diakonikolas, Z Harchaoui - arxiv preprint arxiv:2403.10763, 2024 - arxiv.org
We consider the penalized distributionally robust optimization (DRO) problem with a closed,
convex uncertainty set, a setting that encompasses the $ f $-DRO, Wasserstein-DRO, and …

Learning a Single Neuron Robustly to Distributional Shifts and Adversarial Label Noise

S Li, S Karmalkar, I Diakonikolas… - arxiv preprint arxiv …, 2024 - arxiv.org
We study the problem of learning a single neuron with respect to the $ L_2^ 2$-loss in the
presence of adversarial distribution shifts, where the labels can be arbitrary, and the goal is …

Algorithms for Euclidean-Regularised Optimal Transport

DA Pasechnyuk, M Persiianov, P Dvurechensky… - … on Optimization and …, 2023 - Springer
This paper addresses the Optimal Transport problem, which is regularized by the square of
Euclidean ℓ 2-norm. It offers theoretical guarantees regarding the iteration complexities of …