AUC maximization in the era of big data and AI: A survey

T Yang, Y Ying - ACM Computing Surveys, 2022 - dl.acm.org
Area under the ROC curve, aka AUC, is a measure of choice for assessing the performance
of a classifier for imbalanced data. AUC maximization refers to a learning paradigm that …

Closing the gap: Tighter analysis of alternating stochastic gradient methods for bilevel problems

T Chen, Y Sun, W Yin - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Stochastic nested optimization, including stochastic compositional, min-max, and bilevel
optimization, is gaining popularity in many machine learning applications. While the three …

Fednest: Federated bilevel, minimax, and compositional optimization

DA Tarzanagh, M Li… - … on Machine Learning, 2022 - proceedings.mlr.press
Standard federated optimization methods successfully apply to stochastic problems with
single-level structure. However, many contemporary ML problems-including adversarial …

Decentralized gossip-based stochastic bilevel optimization over communication networks

S Yang, X Zhang, M Wang - Advances in neural information …, 2022 - proceedings.neurips.cc
Bilevel optimization have gained growing interests, with numerous applications found in
meta learning, minimax games, reinforcement learning, and nested composition …

A single-timescale method for stochastic bilevel optimization

T Chen, Y Sun, Q **ao, W Yin - International Conference on …, 2022 - proceedings.mlr.press
Stochastic bilevel optimization generalizes the classic stochastic optimization from the
minimization of a single objective to the minimization of an objective function that depends …

A Single-Timescale Method for Stochastic Bilevel Optimization

T Chen, Y Sun, Q **ao, W Yin - arxiv preprint arxiv:2102.04671, 2021 - arxiv.org
Stochastic bilevel optimization generalizes the classic stochastic optimization from the
minimization of a single objective to the minimization of an objective function that depends …

Decentralized stochastic bilevel optimization with improved per-iteration complexity

X Chen, M Huang, S Ma… - … on Machine Learning, 2023 - proceedings.mlr.press
Bilevel optimization recently has received tremendous attention due to its great success in
solving important machine learning problems like meta learning, reinforcement learning …

On the convergence and sample efficiency of variance-reduced policy gradient method

J Zhang, C Ni, C Szepesvari… - Advances in Neural …, 2021 - proceedings.neurips.cc
Policy gradient (PG) gives rise to a rich class of reinforcement learning (RL) methods.
Recently, there has been an emerging trend to augment the existing PG methods such as …

Randomized stochastic variance-reduced methods for multi-task stochastic bilevel optimization

Z Guo, Q Hu, L Zhang, T Yang - arxiv preprint arxiv:2105.02266, 2021 - arxiv.org
In this paper, we consider non-convex stochastic bilevel optimization (SBO) problems that
have many applications in machine learning. Although numerous studies have proposed …

Solving stochastic compositional optimization is nearly as easy as solving stochastic optimization

T Chen, Y Sun, W Yin - IEEE Transactions on Signal …, 2021 - ieeexplore.ieee.org
Stochastic compositional optimization generalizes classic (non-compositional) stochastic
optimization to the minimization of compositions of functions. Each composition may …