Averaged method of multipliers for bi-level optimization without lower-level strong convexity

R Liu, Y Liu, W Yao, S Zeng… - … Conference on Machine …, 2023 - proceedings.mlr.press
Gradient methods have become mainstream techniques for Bi-Level Optimization (BLO) in
learning fields. The validity of existing works heavily rely on either a restrictive Lower-Level …

Bilevel fast scene adaptation for low-light image enhancement

L Ma, D **, N An, J Liu, X Fan, Z Luo, R Liu - International Journal of …, 2023 - Springer
Enhancing images in low-light scenes is a challenging but widely concerned task in the
computer vision. The mainstream learning-based methods mainly acquire the enhanced …

Bome! bilevel optimization made easy: A simple first-order approach

B Liu, M Ye, S Wright, P Stone… - Advances in neural …, 2022 - proceedings.neurips.cc
Bilevel optimization (BO) is useful for solving a variety of important machine learning
problems including but not limited to hyperparameter optimization, meta-learning, continual …

A fully first-order method for stochastic bilevel optimization

J Kwon, D Kwon, S Wright… - … Conference on Machine …, 2023 - proceedings.mlr.press
We consider stochastic unconstrained bilevel optimization problems when only the first-
order gradient oracles are available. While numerous optimization methods have been …

On penalty-based bilevel gradient descent method

H Shen, T Chen - International Conference on Machine …, 2023 - proceedings.mlr.press
Bilevel optimization enjoys a wide range of applications in hyper-parameter optimization,
meta-learning and reinforcement learning. However, bilevel problems are difficult to solve …

A primal-dual approach to bilevel optimization with multiple inner minima

D Sow, K Ji, Z Guan, Y Liang - arxiv preprint arxiv:2203.01123, 2022 - arxiv.org
Bilevel optimization has found extensive applications in modern machine learning problems
such as hyperparameter optimization, neural architecture search, meta-learning, etc. While …

Projection-free methods for stochastic simple bilevel optimization with convex lower-level problem

J Cao, R Jiang, N Abolfazli… - Advances in …, 2024 - proceedings.neurips.cc
In this paper, we study a class of stochastic bilevel optimization problems, also known as
stochastic simple bilevel optimization, where we minimize a smooth stochastic objective …

Will bilevel optimizers benefit from loops

K Ji, M Liu, Y Liang, L Ying - Advances in Neural …, 2022 - proceedings.neurips.cc
Bilevel optimization has arisen as a powerful tool for solving a variety of machine learning
problems. Two current popular bilevel optimizers AID-BiO and ITD-BiO naturally involve …

Slm: A smoothed first-order lagrangian method for structured constrained nonconvex optimization

S Lu - Advances in Neural Information Processing Systems, 2023 - proceedings.neurips.cc
Functional constrained optimization (FCO) has emerged as a powerful tool for solving
various machine learning problems. However, with the rapid increase in applications of …

Paif: Perception-aware infrared-visible image fusion for attack-tolerant semantic segmentation

Z Liu, J Liu, B Zhang, L Ma, X Fan, R Liu - Proceedings of the 31st ACM …, 2023 - dl.acm.org
Infrared and visible image fusion is a powerful technique that combines complementary
information from different modalities for downstream semantic perception tasks. Existing …