Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arxiv preprint arxiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Nas-bench-suite-zero: Accelerating research on zero cost proxies

A Krishnakumar, C White, A Zela… - Advances in …, 2022 - proceedings.neurips.cc
Zero-cost proxies (ZC proxies) are a recent architecture performance prediction technique
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …

Pasca: A graph neural architecture search system under the scalable paradigm

W Zhang, Y Shen, Z Lin, Y Li, X Li, W Ouyang… - Proceedings of the …, 2022 - dl.acm.org
Graph neural networks (GNNs) have achieved state-of-the-art performance in various graph-
based tasks. However, as mainstream GNNs are designed based on the neural message …

Hyper-tune: Towards efficient hyper-parameter tuning at scale

Y Li, Y Shen, H Jiang, W Zhang, J Li, J Liu… - arxiv preprint arxiv …, 2022 - arxiv.org
The ever-growing demand and complexity of machine learning are putting pressure on
hyper-parameter tuning systems: while the evaluation cost of models continues to increase …

AutoNet-Generated Deep Layer-Wise Convex Networks for ECG Classification

Y Shen, L Lu, T Zhu, X Wang, L Clifton… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
The design of neural networks typically involves trial-and-error, a time-consuming process
for obtaining an optimal architecture, even for experienced researchers. Additionally, it is …

Sonata: Self-adaptive evolutionary framework for hardware-aware neural architecture search

H Bouzidi, S Niar, H Ouarnoughi, EG Talbi - arxiv preprint arxiv …, 2024 - arxiv.org
Recent advancements in Artificial Intelligence (AI), driven by Neural Networks (NN), demand
innovative neural architecture designs, particularly within the constrained environments of …

Efficient black-box adversarial attacks via Bayesian optimization guided by a function prior

S Cheng, Y Miao, Y Dong, X Yang, XS Gao… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper studies the challenging black-box adversarial attack that aims to generate
adversarial examples against a black-box model by only using output feedback of the model …

MOTE-NAS: Multi-Objective Training-based Estimate for Efficient Neural Architecture Search

Y Zhang, J Hsieh, X Li, MC Chang… - Advances in Neural …, 2025 - proceedings.neurips.cc
Abstract Neural Architecture Search (NAS) methods seek effective optimization toward
performance metrics regarding model accuracy and generalization while facing challenges …

UP-NAS: Unified Proxy for Neural Architecture Search

YC Huang, WH Li, CH Tsou… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recently zero-cost proxies for neural architecture search (NAS) have attracted increasing
attention. They allow us to discover top-performing neural networks through architecture …

PATNAS: A Path-Based Training-Free Neural Architecture Search

J Yang, Y Liu, W Wang, H Wu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The development of Neural Architecture Search (NAS) is hindered by high costs associated
with evaluating network architectures. Recently, several zero-cost proxies have been …