Davinz: Data valuation using deep neural networks at initialization

Z Wu, Y Shu, BKH Low - International Conference on …, 2022 - proceedings.mlr.press
Recent years have witnessed a surge of interest in develo** trustworthy methods to
evaluate the value of data in many real-world applications (eg, collaborative machine …

Nas-bench-suite-zero: Accelerating research on zero cost proxies

A Krishnakumar, C White, A Zela… - Advances in …, 2022 - proceedings.neurips.cc
Zero-cost proxies (ZC proxies) are a recent architecture performance prediction technique
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …

Prenas: Preferred one-shot learning towards efficient neural architecture search

H Wang, C Ge, H Chen, X Sun - International Conference on …, 2023 - proceedings.mlr.press
The wide application of pre-trained models is driving the trend of once-for-all training in one-
shot neural architecture search (NAS). However, training within a huge sample space …

Zero-shot neural architecture search: Challenges, solutions, and opportunities

G Li, D Hoang, K Bhardwaj, M Lin… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Recently, zero-shot (or training-free) Neural Architecture Search (NAS) approaches have
been proposed to liberate NAS from the expensive training process. The key idea behind …

Az-nas: Assembling zero-cost proxies for network architecture search

J Lee, B Ham - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
Training-free network architecture search (NAS) aims to discover high-performing networks
with zero-cost proxies capturing network characteristics related to the final performance …

PINNACLE: PINN Adaptive ColLocation and Experimental points selection

GKR Lau, A Hemachandra, SK Ng… - arxiv preprint arxiv …, 2024 - arxiv.org
Physics-Informed Neural Networks (PINNs), which incorporate PDEs as soft constraints,
train with a composite loss function that contains multiple training point types: different types …

Training-free transformer architecture search with zero-cost proxy guided evolution

Q Zhou, K Sheng, X Zheng, K Li, Y Tian… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Transformers have shown remarkable performance, however, their architecture design is a
time-consuming process that demands expertise and trial-and-error. Thus, it is worthwhile to …

NASI: Label-and data-agnostic neural architecture search at initialization

Y Shu, S Cai, Z Dai, BC Ooi, BKH Low - arxiv preprint arxiv:2109.00817, 2021 - arxiv.org
Recent years have witnessed a surging interest in Neural Architecture Search (NAS).
Various algorithms have been proposed to improve the search efficiency and effectiveness …