[HTML][HTML] Optimization algorithms as robust feedback controllers

A Hauswirth, Z He, S Bolognani, G Hug… - Annual Reviews in Control, 2024 - Elsevier
Mathematical optimization is one of the cornerstones of modern engineering research and
practice. Yet, throughout all application domains, mathematical optimization is, for the most …

Automatic design of machine learning via evolutionary computation: A survey

N Li, L Ma, T **ng, G Yu, C Wang, Y Wen, S Cheng… - Applied Soft …, 2023 - Elsevier
Abstract Machine learning (ML), as the most promising paradigm to discover deep
knowledge from data, has been widely applied to practical applications, such as …

Fine-tuning language models with just forward passes

S Malladi, T Gao, E Nichani… - Advances in …, 2023 - proceedings.neurips.cc
Fine-tuning language models (LMs) has yielded success on diverse downstream tasks, but
as LMs grow in size, backpropagation requires a prohibitively large amount of memory …

Data-free model extraction

JB Truong, P Maini, RJ Walls… - Proceedings of the …, 2021 - openaccess.thecvf.com
Current model extraction attacks assume that the adversary has access to a surrogate
dataset with characteristics similar to the proprietary data used to train the victim model. This …

Voice2series: Reprogramming acoustic models for time series classification

CHH Yang, YY Tsai, PY Chen - International conference on …, 2021 - proceedings.mlr.press
Learning to classify time series with limited data is a practical yet challenging problem.
Current methods are primarily based on hand-designed feature extraction rules or domain …

Blackvip: Black-box visual prompting for robust transfer learning

C Oh, H Hwang, H Lee, YT Lim… - Proceedings of the …, 2023 - openaccess.thecvf.com
With the surge of large-scale pre-trained models (PTMs), fine-tuning these models to
numerous downstream tasks becomes a crucial problem. Consequently, parameter efficient …

Advancing model pruning via bi-level optimization

Y Zhang, Y Yao, P Ram, P Zhao… - Advances in …, 2022 - proceedings.neurips.cc
The deployment constraints in practical applications necessitate the pruning of large-scale
deep learning models, ie, promoting their weight sparsity. As illustrated by the Lottery Ticket …

Compute-efficient deep learning: Algorithmic trends and opportunities

BR Bartoldson, B Kailkhura, D Blalock - Journal of Machine Learning …, 2023 - jmlr.org
Although deep learning has made great progress in recent years, the exploding economic
and environmental costs of training neural networks are becoming unsustainable. To …

DeepOPF: A feasibility-optimized deep neural network approach for AC optimal power flow problems

X Pan, M Chen, T Zhao, SH Low - IEEE Systems Journal, 2022 - ieeexplore.ieee.org
To cope with increasing uncertainty from renewable generation and flexible load, grid
operators need to solve alternative current optimal power flow (AC-OPF) problems more …

Surfree: a fast surrogate-free black-box attack

T Maho, T Furon, E Le Merrer - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Abstract Machine learning classifiers are critically prone to evasion attacks. Adversarial
examples are slightly modified inputs that are then misclassified, while remaining …