[HTML][HTML] Optimization algorithms as robust feedback controllers
Mathematical optimization is one of the cornerstones of modern engineering research and
practice. Yet, throughout all application domains, mathematical optimization is, for the most …
practice. Yet, throughout all application domains, mathematical optimization is, for the most …
Automatic design of machine learning via evolutionary computation: A survey
Abstract Machine learning (ML), as the most promising paradigm to discover deep
knowledge from data, has been widely applied to practical applications, such as …
knowledge from data, has been widely applied to practical applications, such as …
Fine-tuning language models with just forward passes
Fine-tuning language models (LMs) has yielded success on diverse downstream tasks, but
as LMs grow in size, backpropagation requires a prohibitively large amount of memory …
as LMs grow in size, backpropagation requires a prohibitively large amount of memory …
Data-free model extraction
Current model extraction attacks assume that the adversary has access to a surrogate
dataset with characteristics similar to the proprietary data used to train the victim model. This …
dataset with characteristics similar to the proprietary data used to train the victim model. This …
Voice2series: Reprogramming acoustic models for time series classification
Learning to classify time series with limited data is a practical yet challenging problem.
Current methods are primarily based on hand-designed feature extraction rules or domain …
Current methods are primarily based on hand-designed feature extraction rules or domain …
Blackvip: Black-box visual prompting for robust transfer learning
With the surge of large-scale pre-trained models (PTMs), fine-tuning these models to
numerous downstream tasks becomes a crucial problem. Consequently, parameter efficient …
numerous downstream tasks becomes a crucial problem. Consequently, parameter efficient …
Advancing model pruning via bi-level optimization
The deployment constraints in practical applications necessitate the pruning of large-scale
deep learning models, ie, promoting their weight sparsity. As illustrated by the Lottery Ticket …
deep learning models, ie, promoting their weight sparsity. As illustrated by the Lottery Ticket …
Compute-efficient deep learning: Algorithmic trends and opportunities
Although deep learning has made great progress in recent years, the exploding economic
and environmental costs of training neural networks are becoming unsustainable. To …
and environmental costs of training neural networks are becoming unsustainable. To …
DeepOPF: A feasibility-optimized deep neural network approach for AC optimal power flow problems
To cope with increasing uncertainty from renewable generation and flexible load, grid
operators need to solve alternative current optimal power flow (AC-OPF) problems more …
operators need to solve alternative current optimal power flow (AC-OPF) problems more …
Surfree: a fast surrogate-free black-box attack
Abstract Machine learning classifiers are critically prone to evasion attacks. Adversarial
examples are slightly modified inputs that are then misclassified, while remaining …
examples are slightly modified inputs that are then misclassified, while remaining …