Averaged method of multipliers for bi-level optimization without lower-level strong convexity
Gradient methods have become mainstream techniques for Bi-Level Optimization (BLO) in
learning fields. The validity of existing works heavily rely on either a restrictive Lower-Level …
learning fields. The validity of existing works heavily rely on either a restrictive Lower-Level …
Bilevel fast scene adaptation for low-light image enhancement
Enhancing images in low-light scenes is a challenging but widely concerned task in the
computer vision. The mainstream learning-based methods mainly acquire the enhanced …
computer vision. The mainstream learning-based methods mainly acquire the enhanced …
Bome! bilevel optimization made easy: A simple first-order approach
Bilevel optimization (BO) is useful for solving a variety of important machine learning
problems including but not limited to hyperparameter optimization, meta-learning, continual …
problems including but not limited to hyperparameter optimization, meta-learning, continual …
A fully first-order method for stochastic bilevel optimization
We consider stochastic unconstrained bilevel optimization problems when only the first-
order gradient oracles are available. While numerous optimization methods have been …
order gradient oracles are available. While numerous optimization methods have been …
On penalty-based bilevel gradient descent method
Bilevel optimization enjoys a wide range of applications in hyper-parameter optimization,
meta-learning and reinforcement learning. However, bilevel problems are difficult to solve …
meta-learning and reinforcement learning. However, bilevel problems are difficult to solve …
A primal-dual approach to bilevel optimization with multiple inner minima
Bilevel optimization has found extensive applications in modern machine learning problems
such as hyperparameter optimization, neural architecture search, meta-learning, etc. While …
such as hyperparameter optimization, neural architecture search, meta-learning, etc. While …
Projection-free methods for stochastic simple bilevel optimization with convex lower-level problem
In this paper, we study a class of stochastic bilevel optimization problems, also known as
stochastic simple bilevel optimization, where we minimize a smooth stochastic objective …
stochastic simple bilevel optimization, where we minimize a smooth stochastic objective …
Will bilevel optimizers benefit from loops
Bilevel optimization has arisen as a powerful tool for solving a variety of machine learning
problems. Two current popular bilevel optimizers AID-BiO and ITD-BiO naturally involve …
problems. Two current popular bilevel optimizers AID-BiO and ITD-BiO naturally involve …
Slm: A smoothed first-order lagrangian method for structured constrained nonconvex optimization
S Lu - Advances in Neural Information Processing Systems, 2023 - proceedings.neurips.cc
Functional constrained optimization (FCO) has emerged as a powerful tool for solving
various machine learning problems. However, with the rapid increase in applications of …
various machine learning problems. However, with the rapid increase in applications of …
Paif: Perception-aware infrared-visible image fusion for attack-tolerant semantic segmentation
Infrared and visible image fusion is a powerful technique that combines complementary
information from different modalities for downstream semantic perception tasks. Existing …
information from different modalities for downstream semantic perception tasks. Existing …