AUC maximization in the era of big data and AI: A survey
Area under the ROC curve, aka AUC, is a measure of choice for assessing the performance
of a classifier for imbalanced data. AUC maximization refers to a learning paradigm that …
of a classifier for imbalanced data. AUC maximization refers to a learning paradigm that …
Closing the gap: Tighter analysis of alternating stochastic gradient methods for bilevel problems
Stochastic nested optimization, including stochastic compositional, min-max, and bilevel
optimization, is gaining popularity in many machine learning applications. While the three …
optimization, is gaining popularity in many machine learning applications. While the three …
Fednest: Federated bilevel, minimax, and compositional optimization
Standard federated optimization methods successfully apply to stochastic problems with
single-level structure. However, many contemporary ML problems-including adversarial …
single-level structure. However, many contemporary ML problems-including adversarial …
Decentralized gossip-based stochastic bilevel optimization over communication networks
Bilevel optimization have gained growing interests, with numerous applications found in
meta learning, minimax games, reinforcement learning, and nested composition …
meta learning, minimax games, reinforcement learning, and nested composition …
A single-timescale method for stochastic bilevel optimization
Stochastic bilevel optimization generalizes the classic stochastic optimization from the
minimization of a single objective to the minimization of an objective function that depends …
minimization of a single objective to the minimization of an objective function that depends …
A Single-Timescale Method for Stochastic Bilevel Optimization
Stochastic bilevel optimization generalizes the classic stochastic optimization from the
minimization of a single objective to the minimization of an objective function that depends …
minimization of a single objective to the minimization of an objective function that depends …
Decentralized stochastic bilevel optimization with improved per-iteration complexity
Bilevel optimization recently has received tremendous attention due to its great success in
solving important machine learning problems like meta learning, reinforcement learning …
solving important machine learning problems like meta learning, reinforcement learning …
On the convergence and sample efficiency of variance-reduced policy gradient method
Policy gradient (PG) gives rise to a rich class of reinforcement learning (RL) methods.
Recently, there has been an emerging trend to augment the existing PG methods such as …
Recently, there has been an emerging trend to augment the existing PG methods such as …
Randomized stochastic variance-reduced methods for multi-task stochastic bilevel optimization
In this paper, we consider non-convex stochastic bilevel optimization (SBO) problems that
have many applications in machine learning. Although numerous studies have proposed …
have many applications in machine learning. Although numerous studies have proposed …
Solving stochastic compositional optimization is nearly as easy as solving stochastic optimization
Stochastic compositional optimization generalizes classic (non-compositional) stochastic
optimization to the minimization of compositions of functions. Each composition may …
optimization to the minimization of compositions of functions. Each composition may …