Auto-train-once: Controller network guided automatic network pruning from scratch

X Wu, S Gao, Z Zhang, Z Li, R Bao… - Proceedings of the …, 2024 - openaccess.thecvf.com
Current techniques for deep neural network (DNN) pruning often involve intricate multi-step
processes that require domain-specific expertise making their widespread adoption …

Solving a class of non-convex minimax optimization in federated learning

X Wu, J Sun, Z Hu, A Zhang… - Advances in Neural …, 2023 - proceedings.neurips.cc
The minimax problems arise throughout machine learning applications, ranging from
adversarial training and policy evaluation in reinforcement learning to AUROC …

A faster decentralized algorithm for nonconvex minimax problems

W **an, F Huang, Y Zhang… - Advances in Neural …, 2021 - proceedings.neurips.cc
In this paper, we study the nonconvex-strongly-concave minimax optimization problem on
decentralized setting. The minimax problems are attracting increasing attentions because of …

Sapd+: An accelerated stochastic method for nonconvex-concave minimax problems

X Zhang, NS Aybat… - Advances in Neural …, 2022 - proceedings.neurips.cc
We propose a new stochastic method SAPD+ for solving nonconvex-concave minimax
problems of the form $\min\max\mathcal {L}(x, y)= f (x)+\Phi (x, y)-g (y) $, where $ f, g $ are …

Nest your adaptive algorithm for parameter-agnostic nonconvex minimax optimization

J Yang, X Li, N He - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Adaptive algorithms like AdaGrad and AMSGrad are successful in nonconvex optimization
owing to their parameter-agnostic ability–requiring no a priori knowledge about problem …

Decentralized riemannian algorithm for nonconvex minimax problems

X Wu, Z Hu, H Huang - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
The minimax optimization over Riemannian manifolds (possibly nonconvex constraints) has
been actively applied to solve many problems, such as robust dimensionality reduction and …

Two-timescale gradient descent ascent algorithms for nonconvex minimax optimization

T Lin, C **, MI Jordan - Journal of Machine Learning Research, 2025 - jmlr.org
We provide a unified analysis of two-timescale gradient descent ascent (TTGDA) for solving
structured nonconvex minimax optimization problems in the form of $\min_x\max_ {y\in Y} f …

An augmented Lagrangian deep learning method for variational problems with essential boundary conditions

J Huang, H Wang, T Zhou - arxiv preprint arxiv:2106.14348, 2021 - arxiv.org
This paper is concerned with a novel deep learning method for variational problems with
essential boundary conditions. To this end, we first reformulate the original problem into a …

Fast Objective & Duality Gap Convergence for Non-Convex Strongly-Concave Min-Max Problems with PL Condition

Z Guo, Y Yan, Z Yuan, T Yang - arxiv preprint arxiv:2006.06889, 2020 - arxiv.org
This paper focuses on stochastic methods for solving smooth non-convex strongly-concave
min-max problems, which have received increasing attention due to their potential …

Gradient descent ascent for minimax problems on Riemannian manifolds

F Huang, S Gao - IEEE Transactions on Pattern Analysis and …, 2023 - ieeexplore.ieee.org
In the paper, we study a class of useful minimax problems on Riemanian manifolds and
propose a class of effective Riemanian gradient-based methods to solve these minimax …