Federated minimax optimization: Improved convergence analyses and algorithms

P Sharma, R Panda, G Joshi… - … on Machine Learning, 2022 - proceedings.mlr.press
In this paper, we consider nonconvex minimax optimization, which is gaining prominence in
many modern machine learning applications, such as GANs. Large-scale edge-based …

A faster decentralized algorithm for nonconvex minimax problems

W **an, F Huang, Y Zhang… - Advances in Neural …, 2021 - proceedings.neurips.cc
In this paper, we study the nonconvex-strongly-concave minimax optimization problem on
decentralized setting. The minimax problems are attracting increasing attentions because of …

Decentralized policy gradient descent ascent for safe multi-agent reinforcement learning

S Lu, K Zhang, T Chen, T Başar, L Horesh - Proceedings of the AAAI …, 2021 - ojs.aaai.org
This paper deals with distributed reinforcement learning problems with safety constraints. In
particular, we consider that a team of agents cooperate in a shared environment, where …

Distributed saddle-point problems under data similarity

A Beznosikov, G Scutari, A Rogozin… - Advances in Neural …, 2021 - proceedings.neurips.cc
We study solution methods for (strongly-) convex-(strongly)-concave Saddle-Point Problems
(SPPs) over networks of two type--master/workers (thus centralized) architectures and mesh …

A decentralized parallel algorithm for training generative adversarial nets

M Liu, W Zhang, Y Mroueh, X Cui… - Advances in …, 2020 - proceedings.neurips.cc
Abstract Generative Adversarial Networks (GANs) are a powerful class of generative models
in the deep learning community. Current practice on large-scale GAN training utilizes large …

Taming communication and sample complexities in decentralized policy evaluation for cooperative multi-agent reinforcement learning

X Zhang, Z Liu, J Liu, Z Zhu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Cooperative multi-agent reinforcement learning (MARL) has received increasing attention in
recent years and has found many scientific and engineering applications. However, a key …

Decentralized local stochastic extra-gradient for variational inequalities

A Beznosikov, P Dvurechenskii… - Advances in …, 2022 - proceedings.neurips.cc
We consider distributed stochastic variational inequalities (VIs) on unbounded domains with
the problem data that is heterogeneous (non-IID) and distributed across many devices. We …

Similarity, compression and local steps: three pillars of efficient communications for distributed variational inequalities

A Beznosikov, M Takác… - Advances in Neural …, 2023 - proceedings.neurips.cc
Variational inequalities are a broad and flexible class of problems that includes
minimization, saddle point, and fixed point problems as special cases. Therefore, variational …

Decentralized distributed optimization for saddle point problems

A Rogozin, A Beznosikov, D Dvinskikh… - arxiv preprint arxiv …, 2021 - arxiv.org
We consider distributed convex-concave saddle point problems over arbitrary connected
undirected networks and propose a decentralized distributed algorithm for their solution. The …

Federated minimax optimization with client heterogeneity

P Sharma, R Panda, G Joshi - arxiv preprint arxiv:2302.04249, 2023 - arxiv.org
Minimax optimization has seen a surge in interest with the advent of modern applications
such as GANs, and it is inherently more challenging than simple minimization. The difficulty …